Meta tags:
Headings (most frequently used words):
distribution, sufficiency, theorem, exponential, proof, uniform, sufficient, statistic, contents, background, mathematical, definition, fisher, neyman, factorization, minimal, examples, rao, blackwell, family, other, types, of, see, also, notes, references, example, likelihood, principle, interpretation, another, bernoulli, with, two, parameters, poisson, normal, gamma, bayesian, linear,
Text of the page (most frequently used words):
the (242), displaystyle (163), theta (106), and (76), sufficient (74), #statistic (67), for (46), left (46), right (45), dots (44), sum (37), #theorem (36), leq (34), that (33), alpha (31), statistics (30), distribution (30), frac (30), edit (28), beta (28), this (27), factorization (26), sufficiency (26), are (26), aligned (26), function (25), data (25), parameter (24), not (24), can (24), over (24), with (23), mid (22), sigma (22), exp (22), probability (21), sample (21), density (20), fisher (20), only (20), overline (19), then (18), independent (18), model (17), does (17), mathbf (17), linear (16), joint (16), statistical (15), likelihood (15), max (15), minimal (15), depend (15), information (14), estimator (14), analysis (14), min (14), neyman (14), which (14), see (13), begin (13), end (13), pdf (13), variance (12), bayesian (12), prod (12), about (11), test (11), exponential (11), maximum (11), doi (11), there (11), unknown (11), from (10), product (10), regression (10), mean (10), family (10), other (10), 5pt (10), because (10), theory (9), transformation (9), parameters (9), given (9), value (9), observations (9), written (9), where (9), all (9), conditional (8), correlation (8), distributions (8), interval (8), plot (8), distributed (8), since (8), lambda (8), wikipedia (7), estimation (7), inference (7), lehmann (7), median (7), random (7), chart (7), thus (7), through (7), gamma (7), ldots (7), proof (7), toggle (6), page (6), was (6), population (6), time (6), but (6), mathematical (6), complete (6), above (6), case (6), real (6), whose (6), one (6), form (6), consider (6), individual (6), two (6), 6pt (6), cdots (6), cases (6), definition (6), upon (6), functions (6), may (5), log (5), rank (5), first (5), vector (5), general (5), series (5), normal (5), factor (5), families (5), parametric (5), rao (5), point (5), isbn (5), 2nd (5), blackwell (5), concept (5), more (5), variables (5), known (5), implies (5), depends (5), takes (5), required (5), densities (5), equality (5), same (5), example (5), table (4), contents (4), search (4), view (4), terms (4), using (4), box (4), multivariate (4), poisson (4), bernoulli (4), posterior (4), alternative (4), power (4), unbiased (4), experiment (4), size (4), normalization (4), dependence (4), casella (4), finite (4), jstor (4), discrete (4), ancillary (4), dimensional (4), set (4), when (4), valued (4), main (4), any (4), expected (4), letting (4), criterion (4), have (4), uniform (4), examples (4), exists (4), such (4), jacobian (4), hand (4), both (4), contains (4), related (4), hide (4), move (4), sidebar (4), subsection (4), under (3), non (3), org (3), index (3), mathematics (3), control (3), design (3), studies (3), models (3), survival (3), least (3), squares (3), domain (3), cross (3), partial (3), tests (3), nonparametric (3), standard (3), simple (3), adaptive (3), bayes (3), uniformly (3), scheffé (3), minimum (3), moments (3), optimal (3), space (3), sampling (3), study (3), reduction (3), line (3), scatter (3), range (3), dodge (3), 2003 (3), 1998 (3), springer (3), encyclopedia (3), journal (3), royal (3), society (3), between (3), issn (3), halmos (3), savage (3), application (3), history (3), theoretical (3), also (3), hat (3), context (3), generally (3), types (3), less (3), some (3), conditions (3), being (3), fully (3), article (3), typically (3), having (3), very (3), get (3), note (3), expression (3), always (3), follows (3), words (3), let (3), denote (3), another (3), member (3), due (3), will (3), principle (3), below (3), points (3), estimate (3), dataset (3), tools (3), languages (2), statement (2), contact (2), privacy (2), policy (2), available (2), use (2), commons (2), last (2), categories (2), articles (2), proofs (2), short (2), description (2), wikidata (2), retrieved (2), portal (2), system (2), engineering (2), clinical (2), failure (2), limit (2), spectral (2), frequency (2), autoregressive (2), specific (2), structural (2), seasonal (2), adjustment (2), stationarity (2), cluster (2), principal (2), components (2), manova (2), contingency (2), categorical (2), anova (2), generalized (2), equations (2), validation (2), coefficient (2), determination (2), pearson (2), moment (2), prior (2), way (2), kolmogorov (2), squared (2), score (2), multiple (2), most (2), bootstrap (2), estimators (2), distance (2), completeness (2), location (2), scale (2), shape (2), designs (2), trial (2), randomized (2), controlled (2), missing (2), collection (2), cleaning (2), feature (2), scaling (2), transform (2), processing (2), dispersion (2), deviation (2), absolute (2), geometric (2), arithmetic (2), continuous (2), descriptive (2), 1994 (2), press (2), references (2), hdl (2), property (2), 1966 (2), approach (2), free (2), 1111 (2), 2517 (2), 6161 (2), 1996 (2), zbl (2), independence (2), 1214 (2), annals (2), wiley (2), 471 (2), 1970 (2), 2638 (2), bibcode (2), edition (2), entry (2), hogg (2), craig (2), 2022 (2), thomas (2), 1973 (2), 439 (2), stigler (2), stephen (2), 1922 (2), 222 (2), notes (2), dimension (2), best (2), its (2), expectation (2), called (2), based (2), out (2), consequence (2), formulation (2), however (2), say (2), obtained (2), every (2), shows (2), possible (2), suppose (2), number (2), increases (2), identically (2), estimated (2), intuitively (2), states (2), pitman (2), koopman (2), darmois (2), useful (2), sometimes (2), easily (2), interacts (2), cdot (2), mvue (2), gives (2), coin (2), constant (2), seen (2), here (2), necessarily (2), while (2), hard (2), find (2), exist (2), particular (2), characterization (2), second (2), remark (2), third (2), proven (2), fourth (2), hypothesis (2), although (2), conditioned (2), what (2), inferences (2), interpretation (2), special (2), many (2), specified (2), provides (2), further (2), itself (2), would (2), than (2), mutual (2), underlying (2), represent (2), jointly (2), background (2), appearance (2), upload (2), file (2), changes (2), links (2), read (2), create (2), account (2), donate (2), menu (2), add, topic, mobile, cookie, developers, code, conduct, legal, safety, contacts, disclaimers, text, additional, apply, site, you, agree, registered, trademark, profit, organization, wikimedia, foundation, inc, creative, attribution, sharealike, license, rendered, parsoid, edited, july, 2026, utc, hidden, containing, different, principles, https, php, title, sufficient_statistic, oldid, 1366488036, wikiproject, category, kriging, geostatistics, geographic, environmental, cartography, spatial, psychometrics, official, national, accounts, jurimetrics, econometrics, demography, crime, census, actuarial, science, social, identification, reliability, quality, process, probabilistic, methods, chemometrics, medical, epidemiology, trials, bioinformatics, biostatistics, applications, nelson, aalen, hazard, hitting, accelerated, aft, proportional, hazards, kaplan, meier, whittle, wavelet, fourier, autoregression, var, heteroskedasticity, arch, arima, jenkins, arma, xcf, pacf, autocorrelation, acf, breusch, godfrey, durbin, watson, ljung, johansen, dickey, fuller, granger, causality, break, cointegration, smoothing, trend, decomposition, elliptical, equation, classification, discriminant, canonical, cochran, mantel, haenszel, mcnemar, graphical, cohen, kappa, degrees, freedom, ancova, partition, regressions, binomial, logistic, homoscedasticity, heteroscedasticity, robust, isotonic, semiparametric, nonlinear, predictors, ordinary, template, splines, mars, simultaneous, mixed, effects, errors, residuals, confounding, variable, credible, van, der, waerden, ordered, jonckheere, terpstra, friedman, kruskal, wallis, mann, whitney, hodges, signed, wilcoxon, sign, bic, aic, selection, normality, shapiro, wilk, jarque, bera, lilliefors, anderson, darling, smirnov, chi, goodness, fit, student, wald, lagrange, multiplier, ratio, comparisons, randomization, permutation, powerful, tails, testing, hypotheses, jackknife, resampling, tolerance, prediction, pivot, confidence, plug, blackwellization, method, estimating, frequentist, sensitivity, robustness, asymptotics, divergence, efficiency, loss, decision, functional, monotone, specification, empirical, order, quasi, natural, sectional, cohort, observational, down, stochastic, approximation, scientific, assignment, interaction, factorial, blocking, experiments, error, questionnaire, opinion, poll, stratified, survey, methodology, replication, effect, detrending, differencing, preprocessing, component, dimensionality, truncation, winsorizing, outlier, unit, standardization, anscombe, stabilizing, yeo, johnson, cox, transformations, ecdf, matrix, heatmap, violin, stem, leaf, display, run, radar, pie, histogram, forest, fan, correlogram, biplot, bar, graphics, spearman, kendall, grouped, summary, tables, count, skewness, kurtosis, central, percentile, interquartile, variation, average, mode, lehmer, heinz, heronian, harmonic, cubic, contraharmonic, center, outline, oup, 920613, oxford, dictionary, chapter, 387, 98502, kholevo, 2001, ems, witting, 1987, 500, 11850, 422507, 2143, ast, 2014984, astin, bulletin, markov, credibility, godambe, new, populations, 328, 2984375, tb00645, 320, goldstein, hagan, systems, expert, assessments, 316, 2345978, tb02083, 301, nogales, oyola, perez, 2000, 0964, 62003, 1731351, 1016, s0167, 7152, 00089, letters, relationship, invariance, ramamoorthi, 1982, 1026, 0485, 62004, 0663456, aos, 1176345895, 1025, classically, section, 92416, smith, bernardo, andersen, erling, bernhard, september, 331, 1255, 0162, 1459, 1080, 01621459, 10481160, 1248, american, association, spaces, tikochinsky, tishby, levine, 1984, 2644, 0556, 2791, 1103, physreva, 1984phrva, 2638t, physical, review, entropy, webpage, connexions, cnx, robert, allen, 1995, prentice, hall, 978, 355722, introduction, taraldsen, 13140, 15068, 87687, preprint, encyclopediaofmath, 1949, 241, 0003, 4851, aoms, 1177730032, 225, radon, nikodym, cover, 2006, joy, hoboken, interscience, 59879802, oclc, 24195, elements, 2002, duxbury, berger, roger, george, december, xxxii, laplace, discovery, 445, 0326872, 2334992, 1093, biomet, biometrika, 604, 368, 91208, 1280, jfm, 2440, 15172, 1098, rsta, 0009, 1922rspta, 309f, 309, 594, philosophical, transactions, foundations, chentsov, basu, formulated, define, predictor, turns, they, directly, equivalent, infinite, results, without, assuming, predictive, condition, involves, full, requirement, almost, longer, situation, complex, existence, sharply, restricts, forms, tersely, parametrized, satisfying, certain, technical, regularity, scalar, increase, mathbb, according, among, vary, remains, bounded, nonexponential, require, capture, finds, kind, better, sense, lower, never, worse, construct, crude, evaluate, various, senses, positive, exponentially, still, holds, rewritten, sqrt, normally, satisfied, reciprocal, factorials, quad, forall, scaled, correct, unscaled, bias, fact, rest, indicator, german, tank, problem, concrete, procedure, distinguishing, fair, biased, crucial, via, satisfies, just, collecting, powers, considering, success, corresponds, total, successes, ratios, usually, exclude, pathological, shown, bahadur, 1954, mild, euclidean, these, hold, associated, stated, longleftrightarrow, captures, efficiently, represented, simplification, derive, explicit, summation, conversely, true, shorthand, notation, deterministic, long, zero, otherwise, therefore, simpler, illustrative, applies, replaced, their, now, divide, members, vanishing, replace, yields, converse, taking, introduced, accordingly, quotient, shall, make, inverse, want, prove, implication, sets, yielding, yield, conjunction, well, leading, identical, easy, multiply, nonzero, factored, into, referred, handle, along, lines, convenient, nonnegative, found, once, arbitrary, even, knowing, provide, slightly, exceeding, exceed, large, amount, bearing, bigl, bigr, alternatively, equals, becomes, inequality, precisely, vectors, doesn, quantities, everything, estimates, consists, equivalently, gaussian, roughly, needed, compute, interact, 1920, noted, had, fallen, favor, strong, assumption, distributional, remained, important, work, sir, ronald, weaker, applied, restricted, deals, notion, algorithmic, structure, computed, relation, closely, concepts, item, projects, printable, version, download, print, export, switch, legacy, parser, shortened, url, cite, permanent, link, actions, english, talk, tiếng, việt, українська, русский, polski, nederlands, 한국어, 日本語, italiano, עברית, français, فارسی, español, deutsch, top, personal, pages, recent, community, learn, help, contribute, current, events, navigation, jump, content,
Text of the page (random words):
inequality becomes an equality i θ t x i θ x displaystyle i bigl theta t x bigr i theta x example edit as an example the sample mean is sufficient for the unknown mean μ of a normal distribution with known variance once the sample mean is known no further information about μ can be obtained from the sample itself on the other hand for an arbitrary distribution the median is not sufficient for the mean even if the median of the sample is known knowing the sample itself would provide further information about the population mean for example if the observations that are less than the median are only slightly less but observations exceeding the median exceed it by a large amount then this would have a bearing on one s inference about the population mean fisher neyman factorization theorem edit fisher s factorization theorem or factorization criterion provides a convenient characterization of a sufficient statistic if the probability density function is ƒ x θ where θ is a parameter then t is sufficient for θ if and only if nonnegative functions g and h can be found such that f x θ h x g θ t x displaystyle f x theta h x g theta t x i e the density ƒ can be factored into a product such that one factor h does not depend on θ and the other factor which does depend on θ depends on x only through t x a general proof of this was given by halmos and savage 6 and the theorem is sometimes referred to as the halmos savage factorization theorem 7 the proofs below handle special cases but an alternative general proof along the same lines can be given 8 in many simple cases the probability density function is fully specified by θ displaystyle theta and t x displaystyle t x and h x 1 displaystyle h x 1 see examples it is easy to see that if f t is a one to one function and t is a sufficient statistic then f t is a sufficient statistic in particular we can multiply a sufficient statistic by a nonzero constant and get another sufficient statistic likelihood principle interpretation edit an implication of the theorem is that when using likelihood based inference two sets of data yielding the same value for the sufficient statistic t x will always yield the same inferences about θ by the factorization criterion the likelihood s dependence on θ is only in conjunction with t x as this is the same in both cases the dependence on θ will be the same as well leading to identical inferences proof edit due to hogg and craig 9 let x 1 x 2 x n displaystyle x_ 1 x_ 2 ldots x_ n denote a random sample from a distribution having the pdf f x θ for ι θ δ let y 1 u 1 x 1 x 2 x n be a statistic whose pdf is g 1 y 1 θ what we want to prove is that y 1 u 1 x 1 x 2 x n is a sufficient statistic for θ if and only if for some function h i 1 n f x i θ g 1 u 1 x 1 x 2 x n θ h x 1 x 2 x n displaystyle prod _ i 1 n f x_ i theta g_ 1 left u_ 1 x_ 1 x_ 2 dots x_ n theta right h x_ 1 x_ 2 dots x_ n first suppose that i 1 n f x i θ g 1 u 1 x 1 x 2 x n θ h x 1 x 2 x n displaystyle prod _ i 1 n f x_ i theta g_ 1 left u_ 1 x_ 1 x_ 2 dots x_ n theta right h x_ 1 x_ 2 dots x_ n we shall make the transformation y i u i x 1 x 2 x n for i 1 n having inverse functions x i w i y 1 y 2 y n for i 1 n and jacobian j w i y j displaystyle j left w_ i y_ j right thus i 1 n f w i y 1 y 2 y n θ j g 1 y 1 θ h w 1 y 1 y 2 y n w n y 1 y 2 y n displaystyle prod _ i 1 n f left w_ i y_ 1 y_ 2 dots y_ n theta right j g_ 1 y_ 1 theta h left w_ 1 y_ 1 y_ 2 dots y_ n dots w_ n y_ 1 y_ 2 dots y_ n right the left hand member is the joint pdf g y 1 y 2 y n θ of y 1 u 1 x 1 x n y n u n x 1 x n in the right hand member g 1 y 1 θ displaystyle g_ 1 y_ 1 theta is the pdf of y 1 displaystyle y_ 1 so that h w 1 w n j displaystyle h w_ 1 dots w_ n j is the quotient of g y 1 y n θ displaystyle g y_ 1 dots y_ n theta and g 1 y 1 θ displaystyle g_ 1 y_ 1 theta that is it is the conditional pdf h y 2 y n y 1 θ displaystyle h y_ 2 dots y_ n mid y_ 1 theta of y 2 y n displaystyle y_ 2 dots y_ n given y 1 y 1 displaystyle y_ 1 y_ 1 but h x 1 x 2 x n displaystyle h x_ 1 x_ 2 dots x_ n and thus h w 1 y 1 y n w n y 1 y n displaystyle h left w_ 1 y_ 1 dots y_ n dots w_ n y_ 1 dots y_ n right was given not to depend upon θ displaystyle theta since θ displaystyle theta was not introduced in the transformation and accordingly not in the jacobian j displaystyle j it follows that h y 2 y n y 1 θ displaystyle h y_ 2 dots y_ n mid y_ 1 theta does not depend upon θ displaystyle theta and that y 1 displaystyle y_ 1 is a sufficient statistics for θ displaystyle theta the converse is proven by taking g y 1 y n θ g 1 y 1 θ h y 2 y n y 1 displaystyle g y_ 1 dots y_ n theta g_ 1 y_ 1 theta h y_ 2 dots y_ n mid y_ 1 where h y 2 y n y 1 displaystyle h y_ 2 dots y_ n mid y_ 1 does not depend upon θ displaystyle theta because y 2 y n displaystyle y_ 2 y_ n depend only upon x 1 x n displaystyle x_ 1 x_ n which are independent on θ displaystyle theta when conditioned by y 1 displaystyle y_ 1 a sufficient statistics by hypothesis now divide both members by the absolute value of the non vanishing jacobian j displaystyle j and replace y 1 y n displaystyle y_ 1 dots y_ n by the functions u 1 x 1 x n u n x 1 x n displaystyle u_ 1 x_ 1 dots x_ n dots u_ n x_ 1 dots x_ n in x 1 x n displaystyle x_ 1 dots x_ n this yields g u 1 x 1 x n u n x 1 x n θ j g 1 u 1 x 1 x n θ h u 2 u n u 1 j displaystyle frac g left u_ 1 x_ 1 dots x_ n dots u_ n x_ 1 dots x_ n theta right j g_ 1 left u_ 1 x_ 1 dots x_ n theta right frac h u_ 2 dots u_ n mid u_ 1 j where j displaystyle j is the jacobian with y 1 y n displaystyle y_ 1 dots y_ n replaced by their value in terms x 1 x n displaystyle x_ 1 dots x_ n the left hand member is necessarily the joint pdf f x 1 θ f x n θ displaystyle f x_ 1 theta cdots f x_ n theta of x 1 x n displaystyle x_ 1 dots x_ n since h y 2 y n y 1 displaystyle h y_ 2 dots y_ n mid y_ 1 and thus h u 2 u n u 1 displaystyle h u_ 2 dots u_ n mid u_ 1 does not depend upon θ displaystyle theta then h x 1 x n h u 2 u n u 1 j displaystyle h x_ 1 dots x_ n frac h u_ 2 dots u_ n mid u_ 1 j is a function that does not depend upon θ displaystyle theta another proof edit a simpler more illustrative proof is as follows although it applies only in the discrete case we use the shorthand notation to denote the joint probability density of x t x displaystyle x t x by f θ x t displaystyle f_ theta x t since t displaystyle t is a deterministic function of x displaystyle x we have f θ x t f θ x displaystyle f_ theta x t f_ theta x as long as t t x displaystyle t t x and zero otherwise therefore f θ x f θ x t f θ x t f θ t f x t f θ t displaystyle begin aligned f_ theta x f_ theta x t 5pt f_ theta x mid t f_ theta t 5pt f x mid t f_ theta t end aligned with the last equality being true by the definition of sufficient statistics thus f θ x a x b θ t displaystyle f_ theta x a x b_ theta t with a x f x t x displaystyle a x f_ x mid t x and b θ t f θ t displaystyle b_ theta t f_ theta t conversely if f θ x a x b θ t displaystyle f_ theta x a x b_ theta t we have f θ t x t x t f θ x t x t x t f θ x x t x t a x b θ t x t x t a x b θ t displaystyle begin aligned f_ theta t sum _ x t x t f_ theta x t 5pt sum _ x t x t f_ theta x 5pt sum _ x t x t a x b_ theta t 5pt left sum _ x t x t a x right b_ theta t end aligned with the first equality by the definition of pdf for multiple variables the second by the remark above the third by hypothesis and the fourth because the summation is not over t displaystyle t let f x t x displaystyle f_ x mid t x denote the conditional probability density of x displaystyle x given t x displaystyle t x then we can derive an explicit expression for this f x t x f θ x t f θ t f θ x f θ t a x b θ t x t x t a x b θ t a x x t x t a x displaystyle begin aligned f_ x mid t x frac f_ theta x t f_ theta t 5pt frac f_ theta x f_ theta t 5pt frac a x b_ theta t left sum _ x t x t a x right b_ theta t 5pt frac a x sum _ x t x t a x end aligned with the first equality by definition of conditional probability density the second by the remark above the third by the equality proven above and the fourth by simplification this expression does not depend on θ displaystyle theta and thus t displaystyle t is a sufficient statistic 10 minimal sufficiency edit a sufficient statistic is minimal sufficient if it can be represented as a function of any other sufficient statistic in other words s x is minimal sufficient if and only if 11 s x is sufficient and if t x is sufficient then there exists a function f such that s x f t x intuitively a minimal sufficient statistic most efficiently captures all possible information about the parameter θ a useful characterization of minimal sufficiency is that when the density f θ exists s x is minimal sufficient if f θ x f θ y displaystyle frac f_ theta x f_ theta y is independent of θ displaystyle longleftrightarrow s x s y this follows as a consequence from fisher s factorization theorem stated above a case in which there is no minimal sufficient statistic was shown by bahadur 1954 12 however under mild conditions a minimal sufficient statistic does always exist in particular in euclidean space these conditions always hold if the random variables associated with p θ displaystyle p_ theta are all discrete or are all continuous if there exists a minimal sufficient statistic and this is usually the case then every complete sufficient statistic is necessarily minimal sufficient 13 note that this statement does not exclude a pathological case in which a complete sufficient exists while there is no minimal sufficient statistic while it is hard to find cases in which a minimal sufficient statistic does not exist it is not so hard to find cases in which there is no complete sufficient statistic the collection of likelihood ratios l x θ i l x θ 0 displaystyle left frac l x mid theta _ i l x mid theta _ 0 right for i 1 k displaystyle i 1 k is a minimal sufficient statistic if the parameter space is discrete θ 0 θ k displaystyle left theta _ 0 theta _ k right examples edit bernoulli distribution edit if x 1 x n are independent bernoulli distributed random variables with expected value p then the sum t x x 1 x n is a sufficient statistic for p here success corresponds to x i 1 and failure to x i 0 so t is the total number of successes this is seen by considering the joint probability distribution pr x x pr x 1 x 1 x 2 x 2 x n x n displaystyle pr x x pr x_ 1 x_ 1 x_ 2 x_ 2 ldots x_ n x_ n because the observations are independent this can be written as p x 1 1 p 1 x 1 p x 2 1 p 1 x 2 p x n 1 p 1 x n displaystyle p x_ 1 1 p 1 x_ 1 p x_ 2 1 p 1 x_ 2 cdots p x_ n 1 p 1 x_ n and collecting powers of p and 1 p gives p x i 1 p n x i p t x 1 p n t x displaystyle p sum x_ i 1 p n sum x_ i p t x 1 p n t x which satisfies the factorization criterion with h x 1 being just a constant note the crucial feature the unknown parameter p interacts with the data x only via the statistic t x σ x i as a concrete application this gives a procedure for distinguishing a fair coin from a biased coin uniform distribution edit see also german tank problem if x 1 x n are independent and uniformly distributed on the interval 0 θ then t x max x 1 x n is sufficient for θ the sample maximum is a sufficient statistic for the population maximum to see this consider the joint probability density function of x x 1 x n because the observations are independent the pdf can be written as a product of individual densities f θ x 1 x n 1 θ 1 0 x 1 θ 1 θ 1 0 x n θ 1 θ n 1 0 min x i 1 max x i θ displaystyle begin aligned f_ theta x_ 1 ldots x_ n frac 1 theta mathbf 1 _ 0 leq x_ 1 leq theta cdots frac 1 theta mathbf 1 _ 0 leq x_ n leq theta 5pt frac 1 theta n mathbf 1 _ 0 leq min x_ i mathbf 1 _ max x_ i leq theta end aligned where 1 is the indicator function thus the density takes form required by the fisher neyman factorization theorem where h x 1 min x i 0 and the rest of the expression is a function of only θ and t x max x i in fact the minimum variance unbiased estimator mvue for θ is n 1 n t x displaystyle frac n 1 n t x this is the sample maximum scaled to correct for the bias and is mvue by the lehmann scheffé theorem unscaled sample maximum t x is the maximum likelihood estimator for θ uniform distribution with two parameters edit if x 1 x n displaystyle x_ 1 x_ n are independent and uniformly distributed on the interval α β displaystyle alpha beta where α displaystyle alpha and β displaystyle beta are unknown parameters then t x 1 n min 1 i n x i max 1 i n x i displaystyle t x_ 1 n left min _ 1 leq i leq n x_ i max _ 1 leq i leq n x_ i right is a two dimensional sufficient statistic for α β displaystyle alpha beta to see this consider the joint probability density function of x 1 n x 1 x n displaystyle x_ 1 n x_ 1 ldots x_ n because the observations are independent the pdf can be written as a product of individual densities i e f x 1 n x 1 n i 1 n 1 β α 1 α x i β 1 β α n 1 α x i β i 1 n 1 β α n 1 α min 1 i n x i 1 max 1 i n x i β displaystyle begin aligned f_ x_ 1 n x_ 1 n prod _ i 1 n left 1 over beta alpha right mathbf 1 _ alpha leq x_ i leq beta left 1 over beta alpha right n mathbf 1 _ alpha leq x_ i leq beta forall i 1 ldots n left 1 over beta alpha right n mathbf 1 _ alpha leq min _ 1 leq i leq n x_ i mathbf 1 _ max _ 1 leq i leq n x_ i leq beta end aligned the joint density of the sample takes the form required by the fisher neyman factorization theorem by letting h x 1 n 1 g α β x 1 n 1 β α n 1 α min 1 i n x i 1 max 1 i n x i β displaystyle begin aligned h x_ 1 n 1 quad g_ alpha beta x_ 1 n left 1 over beta alpha right n mathbf 1 _ alpha leq min _ 1 leq i leq n x_ i mathbf 1 _ max _ 1 leq i leq n x_ i leq beta end aligned since h x 1 n displaystyle h x_ 1 n does not depend on the parameter α β displaystyle alpha beta and g α β x 1 n displaystyle g_ alpha beta x_ 1 n depends only on x 1 n displaystyle x_ 1 n through the function t x 1 n min 1 i n x i max 1 i n x i displaystyle t x_ 1 n left min _ 1 leq i leq n x_ i max _ 1 leq i leq n x_ i right the fisher neyman factorization theorem implies t x 1 n min 1 i n x i max 1 i n x i displaystyle t x_ 1 n left min _ 1 leq i leq n x_ i max _ 1 leq i leq n x_ i right is a sufficient statistic for α β displaystyle alpha beta poisson distribution edit if x 1 x n are independent and have a poisson distribution with parameter λ then the sum t x x 1 x n is a sufficient statistic for λ to see this consider the joint probability distribution pr x x p x 1 x 1 x 2 x 2 x n x n displaystyle pr x x p x_ 1 x_ 1 x_ 2 x_ 2 ldots x_ n x_ n because the observations are independent this can be written as e λ λ x 1 x 1 e λ λ x 2 x 2 e λ λ x n x n displaystyle e lambda lambda x_ 1 over x_ 1 cdot e lambda lambda x_ 2 over x_ 2 cdots e lambda lambda x_ n over x_ n which may be written as e n λ λ x 1 x 2 x n 1 x 1 x 2 x n displaystyle e n lambda lambda x_ 1 x_ 2 cdots x_ n cdot 1 over x_ 1 x_ 2 cdots x_ n which shows that the factorization cr...
|