MLE of the unknown radius Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)MLE of a function of a parameterMLE estimation of spatial effects radiusFinding the MLE of the Pareto distribution and distributionsA question about a Theorem about MLEMLE discrete uniform distributionDefinition of asymptotic varianceMLE for 2 parameter exponential distributionJoint distribution of least square estimates $(hatalpha,hatbeta)$ in a simple linear regression modelUnderstanding the Invariance Property Proof of MLEConsistency of MLE for independent but not identically distributed data

Why are vacuum tubes still used in amateur radios?

How to tell that you are a giant?

Why does the remaining Rebel fleet at the end of Rogue One seem dramatically larger than the one in A New Hope?

What initially awakened the Balrog?

Fundamental Solution of the Pell Equation

How to get all distinct words within a set of lines?

Why is Nikon 1.4g better when Nikon 1.8g is sharper?

What is the appropriate index architecture when forced to implement IsDeleted (soft deletes)?

Generate an RGB colour grid

How much damage would a cupful of neutron star matter do to the Earth?

Performance gap between vector<bool> and array

Chinese Seal on silk painting - what does it mean?

Can the Great Weapon Master feat's damage bonus and accuracy penalty apply to attacks from the Spiritual Weapon spell?

Do I really need to have a message in a novel to appeal to readers?

Effects on objects due to a brief relocation of massive amounts of mass

How does the secondary effect of the Heat Metal spell interact with a creature resistant/immune to fire damage?

A term for a woman complaining about things/begging in a cute/childish way

Maximum summed subsequences with non-adjacent items

How to compare two different files line by line in unix?

An adverb for when you're not exaggerating

How can I reduce the gap between left and right of cdot with a macro?

Is there any word for a place full of confusion?

Can anything be seen from the center of the Boötes void? How dark would it be?

Why do we bend a book to keep it straight?



MLE of the unknown radius



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)MLE of a function of a parameterMLE estimation of spatial effects radiusFinding the MLE of the Pareto distribution and distributionsA question about a Theorem about MLEMLE discrete uniform distributionDefinition of asymptotic varianceMLE for 2 parameter exponential distributionJoint distribution of least square estimates $(hatalpha,hatbeta)$ in a simple linear regression modelUnderstanding the Invariance Property Proof of MLEConsistency of MLE for independent but not identically distributed data



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








1












$begingroup$


Consider this question,




Suppose that $(X_1, Y_1),(X_2, Y_2), . . . ,(X_n, Y_n)$ are the
coordinates of $n$ points chosen independently and uniformly at random
within a circle with center $(0, 0)$ and unknown radius $r$. Obtain
the MLE $hatr_n$ of $r$.




My attempt:



I have thought about the question but I am not able to put it formally. This is my reasoning.
$X_i$ and $Y_i$ are both $uniformly$ $distributed$ independent random variables on a circle of radius $r$ and center at $(0,0)$. Since $(X_i, Y_i)$ are the coordinates of the $i^textth$ point, transforming these coordinates to polar coordinates we get for the $i^textth$ point $(theta_i,a_i)$ (say) where $theta_i$ follows $Uniform(0,2pi)$ and $a_i$ follows $Uniform(0,r)$ independently. Then $a_(n) = max(a_i)$ is the MLE of $r$.



Is this reasoning correct? How do I put it formally? And if not, how should this problem be solved?










share|cite|improve this question











$endgroup$


















    1












    $begingroup$


    Consider this question,




    Suppose that $(X_1, Y_1),(X_2, Y_2), . . . ,(X_n, Y_n)$ are the
    coordinates of $n$ points chosen independently and uniformly at random
    within a circle with center $(0, 0)$ and unknown radius $r$. Obtain
    the MLE $hatr_n$ of $r$.




    My attempt:



    I have thought about the question but I am not able to put it formally. This is my reasoning.
    $X_i$ and $Y_i$ are both $uniformly$ $distributed$ independent random variables on a circle of radius $r$ and center at $(0,0)$. Since $(X_i, Y_i)$ are the coordinates of the $i^textth$ point, transforming these coordinates to polar coordinates we get for the $i^textth$ point $(theta_i,a_i)$ (say) where $theta_i$ follows $Uniform(0,2pi)$ and $a_i$ follows $Uniform(0,r)$ independently. Then $a_(n) = max(a_i)$ is the MLE of $r$.



    Is this reasoning correct? How do I put it formally? And if not, how should this problem be solved?










    share|cite|improve this question











    $endgroup$














      1












      1








      1





      $begingroup$


      Consider this question,




      Suppose that $(X_1, Y_1),(X_2, Y_2), . . . ,(X_n, Y_n)$ are the
      coordinates of $n$ points chosen independently and uniformly at random
      within a circle with center $(0, 0)$ and unknown radius $r$. Obtain
      the MLE $hatr_n$ of $r$.




      My attempt:



      I have thought about the question but I am not able to put it formally. This is my reasoning.
      $X_i$ and $Y_i$ are both $uniformly$ $distributed$ independent random variables on a circle of radius $r$ and center at $(0,0)$. Since $(X_i, Y_i)$ are the coordinates of the $i^textth$ point, transforming these coordinates to polar coordinates we get for the $i^textth$ point $(theta_i,a_i)$ (say) where $theta_i$ follows $Uniform(0,2pi)$ and $a_i$ follows $Uniform(0,r)$ independently. Then $a_(n) = max(a_i)$ is the MLE of $r$.



      Is this reasoning correct? How do I put it formally? And if not, how should this problem be solved?










      share|cite|improve this question











      $endgroup$




      Consider this question,




      Suppose that $(X_1, Y_1),(X_2, Y_2), . . . ,(X_n, Y_n)$ are the
      coordinates of $n$ points chosen independently and uniformly at random
      within a circle with center $(0, 0)$ and unknown radius $r$. Obtain
      the MLE $hatr_n$ of $r$.




      My attempt:



      I have thought about the question but I am not able to put it formally. This is my reasoning.
      $X_i$ and $Y_i$ are both $uniformly$ $distributed$ independent random variables on a circle of radius $r$ and center at $(0,0)$. Since $(X_i, Y_i)$ are the coordinates of the $i^textth$ point, transforming these coordinates to polar coordinates we get for the $i^textth$ point $(theta_i,a_i)$ (say) where $theta_i$ follows $Uniform(0,2pi)$ and $a_i$ follows $Uniform(0,r)$ independently. Then $a_(n) = max(a_i)$ is the MLE of $r$.



      Is this reasoning correct? How do I put it formally? And if not, how should this problem be solved?







      self-study estimation maximum-likelihood inference






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited 2 hours ago







      Sanket Agrawal

















      asked 3 hours ago









      Sanket AgrawalSanket Agrawal

      596




      596




















          2 Answers
          2






          active

          oldest

          votes


















          1












          $begingroup$

          Your reasoning is not quite correct: if $X$ and $Y$ were both independent uniform on $(-r, r)$, then there is positive probability that, for example, the point $(X, Y)$ is close to the point $(r, r)$, which does not lie on the circle of radius $r$ centered at the origin.




          Edit.
          I mistakenly stopped reading after the second sentence of your attempt, where you claim that each $X_i$ and $Y_i$ are independently distributed on $(-r, r)$.
          While that claim is incorrect, the logic following that claim leads to the correct solution (and is frankly more elegant than my solution).
          You may think of my solution below as a formal way to approach this problem.




          What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
          You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.



          First, let's recall a general definition of what it means to be uniformly distributed on a subset of the plane:
          Let $A$ be a subset of the plane with a defined positive area (formally, a Borel subset of $mathbbR^2$ of positive Lebesgue measure, but don't worry about that if those words aren't familiar).
          Then we say that a random vector $(X, Y)$ is distributed uniformly on $A$ if the joint density of $(X, Y)$ is given by
          $$
          f_X, Y(x, y)
          = begincases
          frac1operatornamearea(A) & textif $(x, y) in A$ \
          0 & textotherwise
          endcases
          $$

          This should remind you of the definition of a random variable uniformly distributed on an interval in $mathbbR$:
          We say that a random variable $U$ is distributed uniformly on an interval $[a, b]$ if its density is
          $$
          f_U(u)
          = begincases
          frac1b - a & textif $a le u le b$ \
          0 & textotherwise
          endcases
          $$

          which can be rewritten as
          $$
          f_U(u)
          = begincases
          frac1operatornamelength([a, b]) & textif $u in [a, b]$ \
          0 & textotherwise
          endcases
          $$

          To go from this univariate case to the bivariate case, you replace intervals by subsets of the plane, and length by area (hopefully you can see that this can be done in any number of dimensions by replacing length or area by higher dimensional volume).



          Back to the question at hand.
          What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
          You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.
          Let's call this circle $C_r$; it has area $pi r^2$.
          By what we said above, if $(X, Y)$ is distributed uniformly on $C_r$, then the joint density of $(X, Y)$ is
          $$
          beginaligned
          f_X, Y(x, y mid r)
          &= begincases
          frac1operatornamearea(C_r) & textif $(x, y) in C_r$ \
          0 & textotherwise
          endcases \
          &= begincases
          frac1pi r^2 & textif $x^2 + y^2 le r^2$ \
          0 & textotherwise
          endcases \
          &= frac1pi r^2 mathbf1_C_r(x, y),
          endaligned
          $$

          where $mathbf1_A$ denotes the indicator function of the set $A$.



          If we now have a sample $(X_1, Y_1), ldots, (X_n, Y_n)$ of random vectors independently distributed uniformly on $C_r$ for some unknown $r > 0$, then we can estimate $r$ by maximum likelihood.
          By independence, the likelihood of the sample is
          $$
          beginaligned
          L(r)
          &= prod_i=1^n f_X_i, Y_i(X_i, Y_i mid r) \
          &= prod_i=1^n frac1pi r^2 mathbf1_C_r(X_i, Y_i) \
          &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
          &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
          &= begincases
          frac1pi^n r^2n & textif $X_i^2 + Y^2 le r^2$ for all $i$ \
          0 & textotherwise
          endcases \
          &= begincases
          frac1pi^n r^2n & textif $maxlimits_i (X_i^2 + Y^2) le r^2$ \
          0 & textotherwise
          endcases \
          &= frac1pi^n r^2n mathbf1_[0, r^2]left(maxlimits_i (X_i^2 + Y_i^2)right) \
          &= frac1pi^n r^2n mathbf1_[0, r]left(sqrtmaxlimits_i (X_i^2 + Y_i^2)right) \
          &= frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
          endaligned
          $$

          (By the way, this shows that $max_isqrtX_i^2 + Y_i^2$ is a sufficient statistic!)
          To summarize,
          $$
          L(r)
          = frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
          $$

          Now to find the maximum likelihood estimator $widehatr_n$ of $n$, we have to maximize $L(r)$ with respect to $r$.
          Notice that the indicator function in the final formula for $L(r)$ is either $0$ or $1$, and $1/(pi^n r^2 n) to infty$ as $r downarrow 0$.
          I'll leave it to you to use these clues to figure out the formula for the MLE; you should get a relatively simple (and, in my opinion, intuitive) expression.






          share|cite|improve this answer











          $endgroup$












          • $begingroup$
            I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
            $endgroup$
            – Sanket Agrawal
            2 hours ago










          • $begingroup$
            thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
            $endgroup$
            – Sanket Agrawal
            2 hours ago






          • 1




            $begingroup$
            @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
            $endgroup$
            – Artem Mavrin
            2 hours ago










          • $begingroup$
            okay @ArtemMavrin, thank you.
            $endgroup$
            – Sanket Agrawal
            2 hours ago



















          3












          $begingroup$

          This question is substantially simplified if we recognise that the points give information about the radius $r$ only through their distance from the centre (i.e., the zero point). Let $R_1,R_2,R_3,...$ be these distance values corresponding to each of the points and let $A(r) = pi cdot r^2$ be the area of a circle with radius $r$. Since each sample point is uniform in the sphere we must have:



          $$mathbbP(R_i leq t) = fracA(t)A(r) = fracpi cdot t^2pi cdot r^2 = Big( fractr Big)^2
          quad quad quad textfor all 0 leq t leq r.$$



          This gives the corresponding sample density $p_r(t) = 2t/r^2$ over the support $0 leq t leq r$. As you can see, this sampling density is not uniform over the support. This is actually unsurprising --- the probability density for the distance $R_i$ is proportional to the circumference of a circle with radius equal to that distance.




          The maximum likelihood estimator: The likelihood function for $n$ observed data points is:



          $$L_mathbfr(r) = prod_i=1^n p_r(r_i) propto frac1r^2 cdot mathbbI(r geq r_(n)).$$



          We can see that the likelihood function is strictly decreasing in $r$, so the maximum likelihood estimator (MLE) occurs at the boundary point $hatr_n = r_(n)$. That is, the MLE for the true radius is the maximum of the lengths from the zero point to the sample points. Since the true parameter $r$ is at least as large as the MLE, the MLE is biased, and will tend to underestimate the true radius. Specifically, we have:



          $$beginequation beginaligned
          mathbbE(hatR_n) = mathbbE(R_(n))
          &= int limits_0^r mathbbP(R_(n) > t) dt \[6pt]
          &= int limits_0^r (1 - mathbbP(R_(n) leq t)) dt \[6pt]
          &= int limits_0^r Big( 1 - fract^2nr^2n Big) dt \[6pt]
          &= Bigg[ t - frac12n+1 cdot fract^2n+1r^2n Bigg]_t=0^t=r \[6pt]
          &= r Big( 1 - frac12n+1 Big) \[6pt]
          &= frac2n2n+1 cdot r. \[6pt]
          endaligned endequation$$



          Thus, a bias-corrected scaled version of the MLE is:



          $$tilder_n = frac2n+12n cdot r_(n).$$



          Incidentally, this process can easily be extended to a hypersphere in higher dimensions. In each case the MLE is the maximum distance from the zero point. For a hypershere in $k$ dimensions, the bias-corrected scaled MLE is:



          $$tilder_n = frackn+1kn cdot r_(n).$$






          share|cite|improve this answer









          $endgroup$













            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "65"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f403914%2fmle-of-the-unknown-radius%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            2 Answers
            2






            active

            oldest

            votes








            2 Answers
            2






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1












            $begingroup$

            Your reasoning is not quite correct: if $X$ and $Y$ were both independent uniform on $(-r, r)$, then there is positive probability that, for example, the point $(X, Y)$ is close to the point $(r, r)$, which does not lie on the circle of radius $r$ centered at the origin.




            Edit.
            I mistakenly stopped reading after the second sentence of your attempt, where you claim that each $X_i$ and $Y_i$ are independently distributed on $(-r, r)$.
            While that claim is incorrect, the logic following that claim leads to the correct solution (and is frankly more elegant than my solution).
            You may think of my solution below as a formal way to approach this problem.




            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.



            First, let's recall a general definition of what it means to be uniformly distributed on a subset of the plane:
            Let $A$ be a subset of the plane with a defined positive area (formally, a Borel subset of $mathbbR^2$ of positive Lebesgue measure, but don't worry about that if those words aren't familiar).
            Then we say that a random vector $(X, Y)$ is distributed uniformly on $A$ if the joint density of $(X, Y)$ is given by
            $$
            f_X, Y(x, y)
            = begincases
            frac1operatornamearea(A) & textif $(x, y) in A$ \
            0 & textotherwise
            endcases
            $$

            This should remind you of the definition of a random variable uniformly distributed on an interval in $mathbbR$:
            We say that a random variable $U$ is distributed uniformly on an interval $[a, b]$ if its density is
            $$
            f_U(u)
            = begincases
            frac1b - a & textif $a le u le b$ \
            0 & textotherwise
            endcases
            $$

            which can be rewritten as
            $$
            f_U(u)
            = begincases
            frac1operatornamelength([a, b]) & textif $u in [a, b]$ \
            0 & textotherwise
            endcases
            $$

            To go from this univariate case to the bivariate case, you replace intervals by subsets of the plane, and length by area (hopefully you can see that this can be done in any number of dimensions by replacing length or area by higher dimensional volume).



            Back to the question at hand.
            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.
            Let's call this circle $C_r$; it has area $pi r^2$.
            By what we said above, if $(X, Y)$ is distributed uniformly on $C_r$, then the joint density of $(X, Y)$ is
            $$
            beginaligned
            f_X, Y(x, y mid r)
            &= begincases
            frac1operatornamearea(C_r) & textif $(x, y) in C_r$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi r^2 & textif $x^2 + y^2 le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi r^2 mathbf1_C_r(x, y),
            endaligned
            $$

            where $mathbf1_A$ denotes the indicator function of the set $A$.



            If we now have a sample $(X_1, Y_1), ldots, (X_n, Y_n)$ of random vectors independently distributed uniformly on $C_r$ for some unknown $r > 0$, then we can estimate $r$ by maximum likelihood.
            By independence, the likelihood of the sample is
            $$
            beginaligned
            L(r)
            &= prod_i=1^n f_X_i, Y_i(X_i, Y_i mid r) \
            &= prod_i=1^n frac1pi r^2 mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= begincases
            frac1pi^n r^2n & textif $X_i^2 + Y^2 le r^2$ for all $i$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi^n r^2n & textif $maxlimits_i (X_i^2 + Y^2) le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi^n r^2n mathbf1_[0, r^2]left(maxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(sqrtmaxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            endaligned
            $$

            (By the way, this shows that $max_isqrtX_i^2 + Y_i^2$ is a sufficient statistic!)
            To summarize,
            $$
            L(r)
            = frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            $$

            Now to find the maximum likelihood estimator $widehatr_n$ of $n$, we have to maximize $L(r)$ with respect to $r$.
            Notice that the indicator function in the final formula for $L(r)$ is either $0$ or $1$, and $1/(pi^n r^2 n) to infty$ as $r downarrow 0$.
            I'll leave it to you to use these clues to figure out the formula for the MLE; you should get a relatively simple (and, in my opinion, intuitive) expression.






            share|cite|improve this answer











            $endgroup$












            • $begingroup$
              I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
              $endgroup$
              – Sanket Agrawal
              2 hours ago










            • $begingroup$
              thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
              $endgroup$
              – Sanket Agrawal
              2 hours ago






            • 1




              $begingroup$
              @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
              $endgroup$
              – Artem Mavrin
              2 hours ago










            • $begingroup$
              okay @ArtemMavrin, thank you.
              $endgroup$
              – Sanket Agrawal
              2 hours ago
















            1












            $begingroup$

            Your reasoning is not quite correct: if $X$ and $Y$ were both independent uniform on $(-r, r)$, then there is positive probability that, for example, the point $(X, Y)$ is close to the point $(r, r)$, which does not lie on the circle of radius $r$ centered at the origin.




            Edit.
            I mistakenly stopped reading after the second sentence of your attempt, where you claim that each $X_i$ and $Y_i$ are independently distributed on $(-r, r)$.
            While that claim is incorrect, the logic following that claim leads to the correct solution (and is frankly more elegant than my solution).
            You may think of my solution below as a formal way to approach this problem.




            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.



            First, let's recall a general definition of what it means to be uniformly distributed on a subset of the plane:
            Let $A$ be a subset of the plane with a defined positive area (formally, a Borel subset of $mathbbR^2$ of positive Lebesgue measure, but don't worry about that if those words aren't familiar).
            Then we say that a random vector $(X, Y)$ is distributed uniformly on $A$ if the joint density of $(X, Y)$ is given by
            $$
            f_X, Y(x, y)
            = begincases
            frac1operatornamearea(A) & textif $(x, y) in A$ \
            0 & textotherwise
            endcases
            $$

            This should remind you of the definition of a random variable uniformly distributed on an interval in $mathbbR$:
            We say that a random variable $U$ is distributed uniformly on an interval $[a, b]$ if its density is
            $$
            f_U(u)
            = begincases
            frac1b - a & textif $a le u le b$ \
            0 & textotherwise
            endcases
            $$

            which can be rewritten as
            $$
            f_U(u)
            = begincases
            frac1operatornamelength([a, b]) & textif $u in [a, b]$ \
            0 & textotherwise
            endcases
            $$

            To go from this univariate case to the bivariate case, you replace intervals by subsets of the plane, and length by area (hopefully you can see that this can be done in any number of dimensions by replacing length or area by higher dimensional volume).



            Back to the question at hand.
            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.
            Let's call this circle $C_r$; it has area $pi r^2$.
            By what we said above, if $(X, Y)$ is distributed uniformly on $C_r$, then the joint density of $(X, Y)$ is
            $$
            beginaligned
            f_X, Y(x, y mid r)
            &= begincases
            frac1operatornamearea(C_r) & textif $(x, y) in C_r$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi r^2 & textif $x^2 + y^2 le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi r^2 mathbf1_C_r(x, y),
            endaligned
            $$

            where $mathbf1_A$ denotes the indicator function of the set $A$.



            If we now have a sample $(X_1, Y_1), ldots, (X_n, Y_n)$ of random vectors independently distributed uniformly on $C_r$ for some unknown $r > 0$, then we can estimate $r$ by maximum likelihood.
            By independence, the likelihood of the sample is
            $$
            beginaligned
            L(r)
            &= prod_i=1^n f_X_i, Y_i(X_i, Y_i mid r) \
            &= prod_i=1^n frac1pi r^2 mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= begincases
            frac1pi^n r^2n & textif $X_i^2 + Y^2 le r^2$ for all $i$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi^n r^2n & textif $maxlimits_i (X_i^2 + Y^2) le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi^n r^2n mathbf1_[0, r^2]left(maxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(sqrtmaxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            endaligned
            $$

            (By the way, this shows that $max_isqrtX_i^2 + Y_i^2$ is a sufficient statistic!)
            To summarize,
            $$
            L(r)
            = frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            $$

            Now to find the maximum likelihood estimator $widehatr_n$ of $n$, we have to maximize $L(r)$ with respect to $r$.
            Notice that the indicator function in the final formula for $L(r)$ is either $0$ or $1$, and $1/(pi^n r^2 n) to infty$ as $r downarrow 0$.
            I'll leave it to you to use these clues to figure out the formula for the MLE; you should get a relatively simple (and, in my opinion, intuitive) expression.






            share|cite|improve this answer











            $endgroup$












            • $begingroup$
              I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
              $endgroup$
              – Sanket Agrawal
              2 hours ago










            • $begingroup$
              thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
              $endgroup$
              – Sanket Agrawal
              2 hours ago






            • 1




              $begingroup$
              @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
              $endgroup$
              – Artem Mavrin
              2 hours ago










            • $begingroup$
              okay @ArtemMavrin, thank you.
              $endgroup$
              – Sanket Agrawal
              2 hours ago














            1












            1








            1





            $begingroup$

            Your reasoning is not quite correct: if $X$ and $Y$ were both independent uniform on $(-r, r)$, then there is positive probability that, for example, the point $(X, Y)$ is close to the point $(r, r)$, which does not lie on the circle of radius $r$ centered at the origin.




            Edit.
            I mistakenly stopped reading after the second sentence of your attempt, where you claim that each $X_i$ and $Y_i$ are independently distributed on $(-r, r)$.
            While that claim is incorrect, the logic following that claim leads to the correct solution (and is frankly more elegant than my solution).
            You may think of my solution below as a formal way to approach this problem.




            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.



            First, let's recall a general definition of what it means to be uniformly distributed on a subset of the plane:
            Let $A$ be a subset of the plane with a defined positive area (formally, a Borel subset of $mathbbR^2$ of positive Lebesgue measure, but don't worry about that if those words aren't familiar).
            Then we say that a random vector $(X, Y)$ is distributed uniformly on $A$ if the joint density of $(X, Y)$ is given by
            $$
            f_X, Y(x, y)
            = begincases
            frac1operatornamearea(A) & textif $(x, y) in A$ \
            0 & textotherwise
            endcases
            $$

            This should remind you of the definition of a random variable uniformly distributed on an interval in $mathbbR$:
            We say that a random variable $U$ is distributed uniformly on an interval $[a, b]$ if its density is
            $$
            f_U(u)
            = begincases
            frac1b - a & textif $a le u le b$ \
            0 & textotherwise
            endcases
            $$

            which can be rewritten as
            $$
            f_U(u)
            = begincases
            frac1operatornamelength([a, b]) & textif $u in [a, b]$ \
            0 & textotherwise
            endcases
            $$

            To go from this univariate case to the bivariate case, you replace intervals by subsets of the plane, and length by area (hopefully you can see that this can be done in any number of dimensions by replacing length or area by higher dimensional volume).



            Back to the question at hand.
            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.
            Let's call this circle $C_r$; it has area $pi r^2$.
            By what we said above, if $(X, Y)$ is distributed uniformly on $C_r$, then the joint density of $(X, Y)$ is
            $$
            beginaligned
            f_X, Y(x, y mid r)
            &= begincases
            frac1operatornamearea(C_r) & textif $(x, y) in C_r$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi r^2 & textif $x^2 + y^2 le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi r^2 mathbf1_C_r(x, y),
            endaligned
            $$

            where $mathbf1_A$ denotes the indicator function of the set $A$.



            If we now have a sample $(X_1, Y_1), ldots, (X_n, Y_n)$ of random vectors independently distributed uniformly on $C_r$ for some unknown $r > 0$, then we can estimate $r$ by maximum likelihood.
            By independence, the likelihood of the sample is
            $$
            beginaligned
            L(r)
            &= prod_i=1^n f_X_i, Y_i(X_i, Y_i mid r) \
            &= prod_i=1^n frac1pi r^2 mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= begincases
            frac1pi^n r^2n & textif $X_i^2 + Y^2 le r^2$ for all $i$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi^n r^2n & textif $maxlimits_i (X_i^2 + Y^2) le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi^n r^2n mathbf1_[0, r^2]left(maxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(sqrtmaxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            endaligned
            $$

            (By the way, this shows that $max_isqrtX_i^2 + Y_i^2$ is a sufficient statistic!)
            To summarize,
            $$
            L(r)
            = frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            $$

            Now to find the maximum likelihood estimator $widehatr_n$ of $n$, we have to maximize $L(r)$ with respect to $r$.
            Notice that the indicator function in the final formula for $L(r)$ is either $0$ or $1$, and $1/(pi^n r^2 n) to infty$ as $r downarrow 0$.
            I'll leave it to you to use these clues to figure out the formula for the MLE; you should get a relatively simple (and, in my opinion, intuitive) expression.






            share|cite|improve this answer











            $endgroup$



            Your reasoning is not quite correct: if $X$ and $Y$ were both independent uniform on $(-r, r)$, then there is positive probability that, for example, the point $(X, Y)$ is close to the point $(r, r)$, which does not lie on the circle of radius $r$ centered at the origin.




            Edit.
            I mistakenly stopped reading after the second sentence of your attempt, where you claim that each $X_i$ and $Y_i$ are independently distributed on $(-r, r)$.
            While that claim is incorrect, the logic following that claim leads to the correct solution (and is frankly more elegant than my solution).
            You may think of my solution below as a formal way to approach this problem.




            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.



            First, let's recall a general definition of what it means to be uniformly distributed on a subset of the plane:
            Let $A$ be a subset of the plane with a defined positive area (formally, a Borel subset of $mathbbR^2$ of positive Lebesgue measure, but don't worry about that if those words aren't familiar).
            Then we say that a random vector $(X, Y)$ is distributed uniformly on $A$ if the joint density of $(X, Y)$ is given by
            $$
            f_X, Y(x, y)
            = begincases
            frac1operatornamearea(A) & textif $(x, y) in A$ \
            0 & textotherwise
            endcases
            $$

            This should remind you of the definition of a random variable uniformly distributed on an interval in $mathbbR$:
            We say that a random variable $U$ is distributed uniformly on an interval $[a, b]$ if its density is
            $$
            f_U(u)
            = begincases
            frac1b - a & textif $a le u le b$ \
            0 & textotherwise
            endcases
            $$

            which can be rewritten as
            $$
            f_U(u)
            = begincases
            frac1operatornamelength([a, b]) & textif $u in [a, b]$ \
            0 & textotherwise
            endcases
            $$

            To go from this univariate case to the bivariate case, you replace intervals by subsets of the plane, and length by area (hopefully you can see that this can be done in any number of dimensions by replacing length or area by higher dimensional volume).



            Back to the question at hand.
            What you need to do instead is figure out the joint distribution of each pair $(X, Y)$.
            You are told that $(X, Y)$ is distributed uniformly on the circle of radius $r$ centered at $0$.
            Let's call this circle $C_r$; it has area $pi r^2$.
            By what we said above, if $(X, Y)$ is distributed uniformly on $C_r$, then the joint density of $(X, Y)$ is
            $$
            beginaligned
            f_X, Y(x, y mid r)
            &= begincases
            frac1operatornamearea(C_r) & textif $(x, y) in C_r$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi r^2 & textif $x^2 + y^2 le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi r^2 mathbf1_C_r(x, y),
            endaligned
            $$

            where $mathbf1_A$ denotes the indicator function of the set $A$.



            If we now have a sample $(X_1, Y_1), ldots, (X_n, Y_n)$ of random vectors independently distributed uniformly on $C_r$ for some unknown $r > 0$, then we can estimate $r$ by maximum likelihood.
            By independence, the likelihood of the sample is
            $$
            beginaligned
            L(r)
            &= prod_i=1^n f_X_i, Y_i(X_i, Y_i mid r) \
            &= prod_i=1^n frac1pi r^2 mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= frac1pi^n r^2 n prod_i=1^n mathbf1_C_r(X_i, Y_i) \
            &= begincases
            frac1pi^n r^2n & textif $X_i^2 + Y^2 le r^2$ for all $i$ \
            0 & textotherwise
            endcases \
            &= begincases
            frac1pi^n r^2n & textif $maxlimits_i (X_i^2 + Y^2) le r^2$ \
            0 & textotherwise
            endcases \
            &= frac1pi^n r^2n mathbf1_[0, r^2]left(maxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(sqrtmaxlimits_i (X_i^2 + Y_i^2)right) \
            &= frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            endaligned
            $$

            (By the way, this shows that $max_isqrtX_i^2 + Y_i^2$ is a sufficient statistic!)
            To summarize,
            $$
            L(r)
            = frac1pi^n r^2n mathbf1_[0, r]left(maxlimits_i sqrtX_i^2 + Y_i^2right)
            $$

            Now to find the maximum likelihood estimator $widehatr_n$ of $n$, we have to maximize $L(r)$ with respect to $r$.
            Notice that the indicator function in the final formula for $L(r)$ is either $0$ or $1$, and $1/(pi^n r^2 n) to infty$ as $r downarrow 0$.
            I'll leave it to you to use these clues to figure out the formula for the MLE; you should get a relatively simple (and, in my opinion, intuitive) expression.







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited 2 hours ago

























            answered 3 hours ago









            Artem MavrinArtem Mavrin

            1,328714




            1,328714











            • $begingroup$
              I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
              $endgroup$
              – Sanket Agrawal
              2 hours ago










            • $begingroup$
              thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
              $endgroup$
              – Sanket Agrawal
              2 hours ago






            • 1




              $begingroup$
              @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
              $endgroup$
              – Artem Mavrin
              2 hours ago










            • $begingroup$
              okay @ArtemMavrin, thank you.
              $endgroup$
              – Sanket Agrawal
              2 hours ago

















            • $begingroup$
              I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
              $endgroup$
              – Sanket Agrawal
              2 hours ago










            • $begingroup$
              thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
              $endgroup$
              – Sanket Agrawal
              2 hours ago






            • 1




              $begingroup$
              @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
              $endgroup$
              – Artem Mavrin
              2 hours ago










            • $begingroup$
              okay @ArtemMavrin, thank you.
              $endgroup$
              – Sanket Agrawal
              2 hours ago
















            $begingroup$
            I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
            $endgroup$
            – Sanket Agrawal
            2 hours ago




            $begingroup$
            I am so sorry, I actually meant that $(X_i,Y_i)$ are uniformly chosen from the given circle of radius $r$ and not from the square. It must have slipped while I was typing. I have fixed that.
            $endgroup$
            – Sanket Agrawal
            2 hours ago












            $begingroup$
            thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
            $endgroup$
            – Sanket Agrawal
            2 hours ago




            $begingroup$
            thanks for this answer. However you also say that my logic is also correct. How can I build up on that?
            $endgroup$
            – Sanket Agrawal
            2 hours ago




            1




            1




            $begingroup$
            @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
            $endgroup$
            – Artem Mavrin
            2 hours ago




            $begingroup$
            @SanketAgrawal I see, then your solution looks good to me. The only thing potentially missing is explaining why the polar coordinate variables $(theta_i, a_i)$ are independent and uniformly distributed, which can be done by considering the transformation $(x, y) mapsto (theta, a)$
            $endgroup$
            – Artem Mavrin
            2 hours ago












            $begingroup$
            okay @ArtemMavrin, thank you.
            $endgroup$
            – Sanket Agrawal
            2 hours ago





            $begingroup$
            okay @ArtemMavrin, thank you.
            $endgroup$
            – Sanket Agrawal
            2 hours ago














            3












            $begingroup$

            This question is substantially simplified if we recognise that the points give information about the radius $r$ only through their distance from the centre (i.e., the zero point). Let $R_1,R_2,R_3,...$ be these distance values corresponding to each of the points and let $A(r) = pi cdot r^2$ be the area of a circle with radius $r$. Since each sample point is uniform in the sphere we must have:



            $$mathbbP(R_i leq t) = fracA(t)A(r) = fracpi cdot t^2pi cdot r^2 = Big( fractr Big)^2
            quad quad quad textfor all 0 leq t leq r.$$



            This gives the corresponding sample density $p_r(t) = 2t/r^2$ over the support $0 leq t leq r$. As you can see, this sampling density is not uniform over the support. This is actually unsurprising --- the probability density for the distance $R_i$ is proportional to the circumference of a circle with radius equal to that distance.




            The maximum likelihood estimator: The likelihood function for $n$ observed data points is:



            $$L_mathbfr(r) = prod_i=1^n p_r(r_i) propto frac1r^2 cdot mathbbI(r geq r_(n)).$$



            We can see that the likelihood function is strictly decreasing in $r$, so the maximum likelihood estimator (MLE) occurs at the boundary point $hatr_n = r_(n)$. That is, the MLE for the true radius is the maximum of the lengths from the zero point to the sample points. Since the true parameter $r$ is at least as large as the MLE, the MLE is biased, and will tend to underestimate the true radius. Specifically, we have:



            $$beginequation beginaligned
            mathbbE(hatR_n) = mathbbE(R_(n))
            &= int limits_0^r mathbbP(R_(n) > t) dt \[6pt]
            &= int limits_0^r (1 - mathbbP(R_(n) leq t)) dt \[6pt]
            &= int limits_0^r Big( 1 - fract^2nr^2n Big) dt \[6pt]
            &= Bigg[ t - frac12n+1 cdot fract^2n+1r^2n Bigg]_t=0^t=r \[6pt]
            &= r Big( 1 - frac12n+1 Big) \[6pt]
            &= frac2n2n+1 cdot r. \[6pt]
            endaligned endequation$$



            Thus, a bias-corrected scaled version of the MLE is:



            $$tilder_n = frac2n+12n cdot r_(n).$$



            Incidentally, this process can easily be extended to a hypersphere in higher dimensions. In each case the MLE is the maximum distance from the zero point. For a hypershere in $k$ dimensions, the bias-corrected scaled MLE is:



            $$tilder_n = frackn+1kn cdot r_(n).$$






            share|cite|improve this answer









            $endgroup$

















              3












              $begingroup$

              This question is substantially simplified if we recognise that the points give information about the radius $r$ only through their distance from the centre (i.e., the zero point). Let $R_1,R_2,R_3,...$ be these distance values corresponding to each of the points and let $A(r) = pi cdot r^2$ be the area of a circle with radius $r$. Since each sample point is uniform in the sphere we must have:



              $$mathbbP(R_i leq t) = fracA(t)A(r) = fracpi cdot t^2pi cdot r^2 = Big( fractr Big)^2
              quad quad quad textfor all 0 leq t leq r.$$



              This gives the corresponding sample density $p_r(t) = 2t/r^2$ over the support $0 leq t leq r$. As you can see, this sampling density is not uniform over the support. This is actually unsurprising --- the probability density for the distance $R_i$ is proportional to the circumference of a circle with radius equal to that distance.




              The maximum likelihood estimator: The likelihood function for $n$ observed data points is:



              $$L_mathbfr(r) = prod_i=1^n p_r(r_i) propto frac1r^2 cdot mathbbI(r geq r_(n)).$$



              We can see that the likelihood function is strictly decreasing in $r$, so the maximum likelihood estimator (MLE) occurs at the boundary point $hatr_n = r_(n)$. That is, the MLE for the true radius is the maximum of the lengths from the zero point to the sample points. Since the true parameter $r$ is at least as large as the MLE, the MLE is biased, and will tend to underestimate the true radius. Specifically, we have:



              $$beginequation beginaligned
              mathbbE(hatR_n) = mathbbE(R_(n))
              &= int limits_0^r mathbbP(R_(n) > t) dt \[6pt]
              &= int limits_0^r (1 - mathbbP(R_(n) leq t)) dt \[6pt]
              &= int limits_0^r Big( 1 - fract^2nr^2n Big) dt \[6pt]
              &= Bigg[ t - frac12n+1 cdot fract^2n+1r^2n Bigg]_t=0^t=r \[6pt]
              &= r Big( 1 - frac12n+1 Big) \[6pt]
              &= frac2n2n+1 cdot r. \[6pt]
              endaligned endequation$$



              Thus, a bias-corrected scaled version of the MLE is:



              $$tilder_n = frac2n+12n cdot r_(n).$$



              Incidentally, this process can easily be extended to a hypersphere in higher dimensions. In each case the MLE is the maximum distance from the zero point. For a hypershere in $k$ dimensions, the bias-corrected scaled MLE is:



              $$tilder_n = frackn+1kn cdot r_(n).$$






              share|cite|improve this answer









              $endgroup$















                3












                3








                3





                $begingroup$

                This question is substantially simplified if we recognise that the points give information about the radius $r$ only through their distance from the centre (i.e., the zero point). Let $R_1,R_2,R_3,...$ be these distance values corresponding to each of the points and let $A(r) = pi cdot r^2$ be the area of a circle with radius $r$. Since each sample point is uniform in the sphere we must have:



                $$mathbbP(R_i leq t) = fracA(t)A(r) = fracpi cdot t^2pi cdot r^2 = Big( fractr Big)^2
                quad quad quad textfor all 0 leq t leq r.$$



                This gives the corresponding sample density $p_r(t) = 2t/r^2$ over the support $0 leq t leq r$. As you can see, this sampling density is not uniform over the support. This is actually unsurprising --- the probability density for the distance $R_i$ is proportional to the circumference of a circle with radius equal to that distance.




                The maximum likelihood estimator: The likelihood function for $n$ observed data points is:



                $$L_mathbfr(r) = prod_i=1^n p_r(r_i) propto frac1r^2 cdot mathbbI(r geq r_(n)).$$



                We can see that the likelihood function is strictly decreasing in $r$, so the maximum likelihood estimator (MLE) occurs at the boundary point $hatr_n = r_(n)$. That is, the MLE for the true radius is the maximum of the lengths from the zero point to the sample points. Since the true parameter $r$ is at least as large as the MLE, the MLE is biased, and will tend to underestimate the true radius. Specifically, we have:



                $$beginequation beginaligned
                mathbbE(hatR_n) = mathbbE(R_(n))
                &= int limits_0^r mathbbP(R_(n) > t) dt \[6pt]
                &= int limits_0^r (1 - mathbbP(R_(n) leq t)) dt \[6pt]
                &= int limits_0^r Big( 1 - fract^2nr^2n Big) dt \[6pt]
                &= Bigg[ t - frac12n+1 cdot fract^2n+1r^2n Bigg]_t=0^t=r \[6pt]
                &= r Big( 1 - frac12n+1 Big) \[6pt]
                &= frac2n2n+1 cdot r. \[6pt]
                endaligned endequation$$



                Thus, a bias-corrected scaled version of the MLE is:



                $$tilder_n = frac2n+12n cdot r_(n).$$



                Incidentally, this process can easily be extended to a hypersphere in higher dimensions. In each case the MLE is the maximum distance from the zero point. For a hypershere in $k$ dimensions, the bias-corrected scaled MLE is:



                $$tilder_n = frackn+1kn cdot r_(n).$$






                share|cite|improve this answer









                $endgroup$



                This question is substantially simplified if we recognise that the points give information about the radius $r$ only through their distance from the centre (i.e., the zero point). Let $R_1,R_2,R_3,...$ be these distance values corresponding to each of the points and let $A(r) = pi cdot r^2$ be the area of a circle with radius $r$. Since each sample point is uniform in the sphere we must have:



                $$mathbbP(R_i leq t) = fracA(t)A(r) = fracpi cdot t^2pi cdot r^2 = Big( fractr Big)^2
                quad quad quad textfor all 0 leq t leq r.$$



                This gives the corresponding sample density $p_r(t) = 2t/r^2$ over the support $0 leq t leq r$. As you can see, this sampling density is not uniform over the support. This is actually unsurprising --- the probability density for the distance $R_i$ is proportional to the circumference of a circle with radius equal to that distance.




                The maximum likelihood estimator: The likelihood function for $n$ observed data points is:



                $$L_mathbfr(r) = prod_i=1^n p_r(r_i) propto frac1r^2 cdot mathbbI(r geq r_(n)).$$



                We can see that the likelihood function is strictly decreasing in $r$, so the maximum likelihood estimator (MLE) occurs at the boundary point $hatr_n = r_(n)$. That is, the MLE for the true radius is the maximum of the lengths from the zero point to the sample points. Since the true parameter $r$ is at least as large as the MLE, the MLE is biased, and will tend to underestimate the true radius. Specifically, we have:



                $$beginequation beginaligned
                mathbbE(hatR_n) = mathbbE(R_(n))
                &= int limits_0^r mathbbP(R_(n) > t) dt \[6pt]
                &= int limits_0^r (1 - mathbbP(R_(n) leq t)) dt \[6pt]
                &= int limits_0^r Big( 1 - fract^2nr^2n Big) dt \[6pt]
                &= Bigg[ t - frac12n+1 cdot fract^2n+1r^2n Bigg]_t=0^t=r \[6pt]
                &= r Big( 1 - frac12n+1 Big) \[6pt]
                &= frac2n2n+1 cdot r. \[6pt]
                endaligned endequation$$



                Thus, a bias-corrected scaled version of the MLE is:



                $$tilder_n = frac2n+12n cdot r_(n).$$



                Incidentally, this process can easily be extended to a hypersphere in higher dimensions. In each case the MLE is the maximum distance from the zero point. For a hypershere in $k$ dimensions, the bias-corrected scaled MLE is:



                $$tilder_n = frackn+1kn cdot r_(n).$$







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered 41 mins ago









                BenBen

                28.8k233129




                28.8k233129



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Cross Validated!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid …


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f403914%2fmle-of-the-unknown-radius%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    What does “fit” mean in this sentence? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)How does 'jealousy' mean 'suspicion'?What does “not so say” mean?Does “somebody of my caliber” mean the speaker themselves?“accounting for high fasting blood glucose”- help about the meaningWhat does “cloaked by NDA” mean in this context?What does it mean by 'community ownership' in this context?What does “human corroborators” mean in this context?What does “everything but a fire” mean in this context?What does “run” mean here?What does “rabbited” mean/imply in this sentence?

                    History of India Contents Prehistoric era (until c. 3300 BCE) Bronze Age – "First urbanisation" (c. 3300 – c. 1800 BCE) Climate change, de-urbanisation, and Indo-Aryan migrations (c.1800 – 1500 BCE) Iron Age - Vedic period (c. 1500 – c. 600 BCE) "Second urbanisation" (c. 600 – c. 200 BCE) Classical to early medieval periods (c. 200 BCE – c. 1200 CE) Late medieval period (c. 1200 – 1526 CE) Early modern period (c. 1526–1858 CE) Modern period and independence (after c. 1850 CE) Historiography See also References Further reading External links Navigation menureviewedee[update]The crisisThe Evolution and History of Human Populations in South Asia: Inter-disciplinary Studies in Archaeology, Biological Anthropology, Linguistics and GeneticsThe Ancient Indus: Urbanism, Economy, and Society"Indus River Valley Civilizations"The Ancient Indus: Urbanism, Economy, and Society"India before the British: The Mughal Empire and its Rivals, 1526–1857"Why Europe Grew Rich and Asia Did Not: Global Economic Divergence, 1600–1850Development Centre Studies The World Economy Historical Statistics: Historical StatisticsDeveloping cultures: case studiesEthnic Groups of South Asia and the Pacific: An Encyclopedia: An Encyclopedia"Indian Economy During British Rule""Economic Impact of the British Rule in India | Indian History"The Bone Readers: Science and Politics in Human Origins Research"Out of Africa: new hypotheses and evidence for the dispersal of Homo sapiens along the Indian Ocean rim"10.3109/0301446100363924920334598"Genetic and archaeological perspectives on the initial modern human colonization of southern Asia"2013PNAS..11010699M10.1073/pnas.1306043110369678523754394"Edakkal Caves|Places Around in Wayanad"Protecting megaliths to keep history alive The Hindu daily"Archaeologists rock solid behind Edakkal Cave"The Global Prehistory of Human Migration"Indus Valley 2,000 years older than thought"the original"Stepwells -Cosmology of Subterranean Architecture as seen in Adalaj"A History of Ancient and Early medieval India : from the Stone Age to the 12th century"Stone celts in Harappa"the original"Peoples and languages in pre-islamic Indus valley"the original"The Sindhi language"the originalThe Aryan chromosome"Fluvial landscapes of the Harappan Civilization"2012PNAS..109E1688G10.1073/pnas.1112743109338705422645375"Is River Ghaggar, Saraswati? Geochemical Constraints""An Ancient Civilization, Upended by Climate Change""Huge Ancient Civilization's Collapse Explained"2003GeoRL..30.1425S10.1029/2002GL0168222006QSRv...25.1283M10.1016/j.quascirev.2005.10.0122011QuInt.229..140M10.1016/j.quaint.2009.11.012Climate Change and the Course of Global History: A Rough JourneyA History of Ancient and Early Medieval India: From the Stone Age to the 12th CenturyA History of Ancient and Mediaeval India: From the Stone Age to the 12th CenturyAntennae SwordA History of IndiaA History of IndiaAn Introduction to Hinduism"India: The Late 2nd Millennium and the Reemergence of Urbanism"The Coinage of Ancient IndiaA Sanskrit reader: with vocabulary and notesPedigree: the origins of words from nature"Early Sanskritization. Origins and Development of the Kuru State"10.11588/ejvs.1995.4.823The Sanskrit epics, Part 2The City in South AsiaThe UpanishadsAn Introduction to HinduismReligions of the World, Second Edition: A Comprehensive Encyclopedia of Beliefs and PracticesA History of Ancient and Early Medieval India: From the Stone Age to the 12th CenturyEarly India: From the Origins to AD 1300Republics in ancient Indiapp. 83ff"Magadha Empire""Lumbini Development Trust: Restoring the Lumbini Garden"the originalThe great armies of antiquityarchived"The Achaemenid Persian Empire (550–330 B.C.)""East–West Orientation of Historical Empires"1076-156X"Dinner on the Grand Trunk Road"10.2307/32502263250226"Silappathikaram Tamil Literature"the originalManimekalai – English transliteration of Tamil originalIndian Temple Architecture: Form and Transformation : the Karṇāṭa Drāviḍa Tradition, 7th to 13th CenturiesBuddhist ArchitectureA History of India"The World Economy (GDP) : Historical Statistics by Professor Angus Maddison"The World Economy – Volume 1: A Millennial Perspective and Volume 2: Historical Statistics10.2307/32502140004-36483250214A Comprehensive History of India: Volume 2Between the Empires: Society in India, 300 to 400Emergence of Viṣṇu and Śiva Images in India: Numismatic and Sculptural Evidence"Parthian Pair of Earrings"the originalThe Medical Times and Gazette, Volume 1Greatest emporium in the worldThe Cambridge History of Ancient China: From the Origins of Civilization to 221 BCBuddhist Records of the Western WorldArchaeology in Soviet Central AsiaThe Grandeur of Gandhara: The Ancient Buddhist Civilization of the Swat, Peshawar, Kabul and Indus ValleysIndian Sculpture: Circa 500 B.C.-A.D. 700"The History of Pakistan: The Kushans"Gupta Dynasty – MSN Encartathe original"India – Historical Setting – The Classical Age – Gupta and Harsha""Gupta Dynasty, Golden Age Of India"the original"The Age of the Guptas and After"the originalNumber Theory and Its History"Gupta dynasty (Indian dynasty)""Gupta dynasty: empire in 4th century"the original"The Story of India – Photo Gallery"The ASI say499315420"Pallava script"p. 145"CNG: eAuction 329. INDIA, Post-Gupta (Ganges Valley). Vardhanas of Thanesar and Kanauj. Harshavardhana. Circa AD 606–647. AR Drachm (13mm, 2.28 g, 1h)""Harsha""Sthanvishvara (historical region, India)""Harsha (Indian emperor)"Shyama Kumar Chattopadhyaya (2000) The Philosophy of Sankar's Advaita VedantaShankara's IntroductionShankara's Introduction19373677Shankara's IntroductionIs The Buddhist 'No-Self' Doctrine Compatible With Pursuing Nirvana?The Seven Spiritual Laws Of YogaIndia: The Ancient Past. A History of the Indian-Subcontinent from 7000 BC to AD 1200The Kashmir Series: Glimpses of Kashmiri Culture – Vivekananda Kendra, Kanyakumari (p. 57).Al-Hind: Early Medieval India and the Expansion of Islam, 7th–11th CenturiesHistory of GopāchalaLand of Two Rivers: A History of Bengal from the Mahabharata to MujibEuropean Trade and Colonial ConquestA History of IndiaA Comprehensive History Of Ancient India (3 Vol. Set)"The Last Years of Cholas: The decline and fall of a dynasty"the originalFascinating Hindutva: Saffron Politics and Dalit MobilisationGazetteer of the province of OudhAl- Hind: The slave kings and the Islamic conquest. 2"Shahi Family"The Cambridge history of Islam"Ameer Nasir-ood-deen Subooktugeen"Gazetteer of the Attock District, 1930, Part 1Land of seven rivers: History of India's GeographyTemple Desecration and Indo-Muslim StatesIslam in South Asia: A Short HistoryBeyond Orientalism: The Work of Wilhelm Halbfass and Its Impact on Indian and Cross-cultural StudiesThe Making of Terrorism in Pakistan: Historical and Social Roots of ExtremismOrnament in Indian ArchitectureA historical review of Hindu India: 300 B.C. to 1200 A.D."Indian States and Union Territories"Islam in South Asia: A Short HistoryA Brief History of the Indian PeoplesThe Modern ReviewDelhi Sultanate"Battuta's Travels: Delhi, capital of Muslim India"the original"Timur – conquest of India"the originalIndia HandbookBhaktiThe Four Denomination of Hinduism10.1007/s11407-008-9049-925691067"Vijayanagara Research Project::Elephant Stables"10.2307/26465262646526Historical Dictionary of the TamilsBihar General Knowledge DigestMapping Bihar: From Medieval to Modern TimesPopular Literature and Pre-modern Societies in South AsiaA manual of the Kistna district in the presidency of MadrasAncient Indian History and CivilizationFragmented Memories: Struggling to be Tai-Ahom in India"The Islamic World to 1600: Rise of the Great Islamic Empires (The Mughal Empire)"the originalDynasties: A Global History of Power, 1300–1800, p. 105"Whose fort is it anyway"10.1111/0020-8833.000532600793Development Centre Studies The World Economy Historical Statistics: Historical Statistics"India's Deindustrialization in the 18th and 19th Centuries"The Mughal Empire, p. 190"The Long Globalization and Textile Producers in India"The Mughal World: Life in India's Last Golden AgeAurangzeb: The Life and Legacy of India's Most Controversial KingIn the Shadow of the Taj: A Portrait of Agra"Iran in the Age of the Raj"p. 8610.2307/20539802053980Delhi, the Capital of IndiaAn Advanced History of Modern India"Journal of the Tanjore Maharaja Serfoji's Sarasvati Mahal Library"The Rediscovery of India: A New SubcontinentIslamic Renaissance In South Asia (1707–1867) : The Role Of Shah Waliallah & His SuccessorsAn Advanced History of Modern IndiaThe Great Maratha Mahadaji Scindia"Full text of "Selections from the papers of Lord Metcalfe; late governor-general of India, governor of Jamaica, and governor-general of Canada""The Discovery Of IndiaThe Sacred City of the Hindus: An Account of Benares in Ancient and Modern TimesResurrecting Banaras: Urban Space, Architecture and Religious BoundariesFaith & Philosophy of Sikhism"Missiles mainstay of Pak's N-arsenal"History Modern India By S.N. Sen"Sirajuddaula"ArchivedLongman History & Civics (Dual Government in Bengal)Madhya Pradesh National Means-Cum-Merit Scholarship Exam (Warren Hasting's system of Dual Government)A Military History of Britain: from 1775 to the PresentIndian Cultural Heritage Perspective For TourismHindu Rulers, Muslim Subjects: Islam, Rights, and the History of KashmirIndian HistoryAn Atlas and Survey of South Asian HistoryAn Historical Account of the British Trade Over the Caspian SeaIndian Merchants and Eurasian Trade, 1600–1750The Indian diaspora in Central Asia and its trade, 1550–1900From Constantinople to the home of Omar Khayyam: travels in Transcaucasia and northern Persia for historic and literary researchA journey from Bengal to England: through the northern part of India, Kashmire, Afghanistan, and Persia, and into Russia, by the Caspian-SeaA Second Journey through Persia, Armenia, and Asia Minor, to Constantinople, between the Years 1810 and 1816Reports from the consuls of the United States, 1887Portugal and its Empire, 1250–1800 (Collected Essays in Memory of Glenn J. Ames).: Portuguese Studies Review, Vol. 17, No. 1The Dutch Power in Kerala, 1729–1758http://mod.nic.inArchivedDossier Goa – A Recusa do Sacrifício InútilAn Imperial Crisis in British India: The Manipur Uprising of 1891The Truth of Babri Mosque"Kolkata (Calcutta) : History"the original"Robert Clive, Baron Clive, 'Clive of India', 1725–1774""The Transformation from a Pre-Colonial to a Colonial Order: The Case of India"10.2307/25955872595587A versatile geniusArchived10.1109/MWSYM.1997.602854"Rabindranath Tagore on Education"the original"Essay on 'Derozio and the Young Bengal Movement'"Poverty and Famines: An Essay on Entitlement and Deprivation"Plague"the originalPopulation Growth and Land Use"Reintegrating India with the World Economy""Census Of India 1931"A history of modern India, 1480–1950"'India's well-timed diversification of army helped democracy' | Business Standard News"Bal Gangadhar Tilak: Struggle for Swaraj"Participants from the Indian subcontinent in the First World War""Commonwealth War Graves Commission Annual Report 2007–2008 Online"the original1462689197110.1017/s0010417500016534178920Eurocentrism: a marxian critical realist critique"Ranjit Guha, "On Some Aspects of Historiography of Colonial India""10.2307/2168385216838510.7202/016593ar"Harvard scholar says the idea of India dates to a much earlier time than the British or the Mughals""In The Footsteps of Pilgrims""India's spiritual landscape: The heavens and the earth""India: A Sacred Geography by Diana L Eck – review"Modern India: The Origins of an Asian Democracy10.2307/21694222169422964322464"The Indian Subcontinent and 'Out of Africa 1'"254043308Encyclopedia of World ReligionsThe Evolution and History of Human Populations in South Asia: Inter-disciplinary Studies in Archaeology, Biological Anthropology, Linguistics and Genetics"The Early Paleolithic of the Indian Subcontinent: Hominin Colonization, Dispersals and Occupation History"Ancient Indian History and CivilizationAncient Indian Social History: Some Interpretationsthe originalIndia Before EuropeA Concise History of Modern India"The beginning of the historical period, c. 500–150 BCE"full textA History of Indiathe originalexcerpt and text searchexcerptexcerptAn Economic History of India: From Pre-Colonial Times to 1991excerpt and text searchexcerpt and text searchIndia as known to the ancient world10.1111/j.1468-0289.1985.tb00391.x2597191onlineThe History of India, as told by its own historians. The Muhammadan Periodonline editionHans William Brown research collection on 19th-century missionary work in India, 1882–1932, Ms. Coll. 1033, Kislak Center for Special Collections, Rare Books and Manuscripts, University of Pennsylvaniaee

                    What is the difference between Castle Defense and Tower Defense? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)What is the 17th achievement in Bloons TD4 for iPhone?Anyone has table of piercing and damage for each tower in bloon tower defense?Which tower consumptions benefit a Temple of the Monkey God, and how, exactly?What's the difference between “first”, “last”, “close”, and “strong”?How do you upgrade towers in Bloons Tower Defense?What does the Submarine do in BTD5?Bloons Tower Defense 5 Upgrade PathsDo the Double Shot and Bloonjtsu upgrades pierce more bloons?What is the Water's Edge terrain needed to build the Pirate School Special Building?What determines the difficulty for capturing a tile?