Why is this estimator biased?












1












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    44 mins ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    37 mins ago
















1












$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    44 mins ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    37 mins ago














1












1








1





$begingroup$


$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias







share|cite|improve this question









$endgroup$




$X_{1},X_{2},..,X_{n}$ are iid $sim Poisson(mu)$



than the MLE for $theta=e^{-mu}$ is $hat theta =e^{-bar x}$



Why is this considered to be biased for $theta$?



Is $E[hat theta]$ not $theta$ ?



as



$E[bar x]= mu$






estimation poisson-distribution bias




estimation poisson-distribution bias






share|cite|improve this question













share|cite|improve this question











share|cite|improve this question




share|cite|improve this question










asked 51 mins ago









QualityQuality

29019




29019








  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    44 mins ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    37 mins ago














  • 3




    $begingroup$
    E[f(X)] != f(E[X]) in general.
    $endgroup$
    – The Laconic
    44 mins ago












  • $begingroup$
    I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
    $endgroup$
    – Quality
    37 mins ago








3




3




$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
44 mins ago






$begingroup$
E[f(X)] != f(E[X]) in general.
$endgroup$
– The Laconic
44 mins ago














$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
37 mins ago




$begingroup$
I know that general result but I am still confused how to do it here since the sum of poisson is also poisson with mean $n mu$
$endgroup$
– Quality
37 mins ago










2 Answers
2






active

oldest

votes


















3












$begingroup$

Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
$$
E[e^{s X}] = exp(mu(e^s - 1))
$$
for all $s in mathbb{R}$



Proof.
We just compute:
$$
begin{aligned}
E[e^{s X}]
&= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
&= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
&= e^{-mu} e^{mu e^s} \
&= exp(mu(e^s - 1)).
end{aligned}
$$
We will use this result with $s = -1/n$.



If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
$$
widehat{theta}
= expleft(-frac{1}{n} sum_{i=1}^n X_iright)
= prod_{i=1}^n expleft(-frac{X_i}{n}right),
$$
then, using independence,
$$
begin{aligned}
E[widehat{theta}]
&= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
&= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
&= exp(n mu(e^{-1/n} - 1)) \
&neq e^{-mu},
end{aligned}
$$
so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    23 mins ago



















2












$begingroup$

As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



$$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



, provided the expectations exist.



Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



The equality does not hold because $g$ is not an affine function or a constant function.






share|cite|improve this answer









$endgroup$













    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "65"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: false,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: null,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    3












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      23 mins ago
















    3












    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$













    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      23 mins ago














    3












    3








    3





    $begingroup$

    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$






    share|cite|improve this answer









    $endgroup$



    Recall that the moment generating function of $X sim operatorname{Poisson}(mu)$ is
    $$
    E[e^{s X}] = exp(mu(e^s - 1))
    $$
    for all $s in mathbb{R}$



    Proof.
    We just compute:
    $$
    begin{aligned}
    E[e^{s X}]
    &= sum_{k=0}^infty e^{s k} e^{-mu} frac{mu^k}{k!} \
    &= e^{-mu} sum_{k=0}^infty frac{left(mu e^sright)^k}{k!} \
    &= e^{-mu} e^{mu e^s} \
    &= exp(mu(e^s - 1)).
    end{aligned}
    $$
    We will use this result with $s = -1/n$.



    If $X_1, ldots, X_n sim operatorname{Poisson}(mu)$ are i.i.d. and
    $$
    widehat{theta}
    = expleft(-frac{1}{n} sum_{i=1}^n X_iright)
    = prod_{i=1}^n expleft(-frac{X_i}{n}right),
    $$
    then, using independence,
    $$
    begin{aligned}
    E[widehat{theta}]
    &= prod_{i=1}^n Eleft[e^{-X_i / n}right] \
    &= prod_{i=1}^n exp(mu(e^{-1/n} - 1)) \
    &= exp(n mu(e^{-1/n} - 1)) \
    &neq e^{-mu},
    end{aligned}
    $$
    so $widehat{theta}$ is not an unbiased estimator of $e^{-mu}$







    share|cite|improve this answer












    share|cite|improve this answer



    share|cite|improve this answer










    answered 27 mins ago









    Artem MavrinArtem Mavrin

    1,066710




    1,066710












    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      23 mins ago


















    • $begingroup$
      Thank you, makes perfect sense
      $endgroup$
      – Quality
      23 mins ago
















    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    23 mins ago




    $begingroup$
    Thank you, makes perfect sense
    $endgroup$
    – Quality
    23 mins ago













    2












    $begingroup$

    As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



    $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



    , provided the expectations exist.



    Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



    The equality does not hold because $g$ is not an affine function or a constant function.






    share|cite|improve this answer









    $endgroup$


















      2












      $begingroup$

      As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



      $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



      , provided the expectations exist.



      Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



      The equality does not hold because $g$ is not an affine function or a constant function.






      share|cite|improve this answer









      $endgroup$
















        2












        2








        2





        $begingroup$

        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.






        share|cite|improve this answer









        $endgroup$



        As an aside from finding the exact expectation, you can use Jensen's inequality, which says that for a random variable $X$ and a convex function $g$,



        $$Eleft[g(X)right]ge gleft(Eleft[Xright]right)$$



        , provided the expectations exist.



        Verify that $g(x)=e^{-x}$ is a convex function from the fact that $g''>0$.



        The equality does not hold because $g$ is not an affine function or a constant function.







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered 22 mins ago









        StubbornAtomStubbornAtom

        2,7671532




        2,7671532






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Cross Validated!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f398954%2fwhy-is-this-estimator-biased%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            Why is a white electrical wire connected to 2 black wires?

            Image
            1 I just opened my ceiling light to replace it with another mount. I see a white wire connected to 2 black wires, is that right? The middle switch controls this ceiling light. electrical ceiling light share | improve this question asked 4 hours ago konyak konyak 108 4 New contributor konyak is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct. ...
            Read more

            Waikiki

            Image
            Denne artikkelen kan ha godt av ein språkvask , som reinskar opp målføringa og/eller innfører same språkstilen overalt. Denne artikkelen kan ha godt av ei opprydding for å nå ein høgare standard og/eller for å verta i tråd med standardoppsettet. Sjå korleis du redigerer ei side og stilmanualen for hjelp. Waikiki Land   USA Stat Hawaii Stad Honolulu Wikimedia Commons: Waikiki Utsyn over Waikiki Waikīkī er ein bydel i Honolulu, sør på øya Oahu, som er ei av Hawaii-øyane. Waikīkīstranda er ein av dei meste berømte strendene i verda. Waikīkī strekkjer seg langs stillehavskysten og har ei rekkje velrenommerte hotell. Bydelen er Hawaii-turismens høyborg. På Waikīkī Beach står ei statue av den lokale sportsstjerna Duka Kahanamoku. Kjelder | Denne artikkelen bygger på «Waikiki» frå Wikipedia på bokmål, den 4. november 2018. Denne artikkelen manglar kjelder eller referansar . Hjelp Wikipedia med å finna truverdige kjelder...
            Read more

            What are all the squawk codes?

            Image
            2 $begingroup$ I love aviation and I love learning new things about it. I was wondering if anyone knew all of the squawk codes and in particular what squawk 7500 means. squawk-codes share | improve this question edited 15 mins ago Jamiec ♦ 14.8k 4 60 91 asked 5 hours ago Zac Callaghan Zac Callaghan 11 2 New contributor Zac Callaghan is a new co...
            Read more