Search on Cross Validated… 1

SPONSORED BY

Home
Clarification: The covariance of intercept and slope in simple linear Ask Question

Questions
regression?
Tags
Asked 6 years, 1 month ago Active 5 years, 4 months ago Viewed 17k times
Users

Unanswered Help me understand this relatively simple (I think) concept:

Featured on Meta

5 The covariance of the intercept (𝛽0 ) and the slope (𝛽1 ) in simple linear regression.
Swag is coming back!

Furthermore, what range of values can this covariance take on?

Hot Meta Posts

covariance regression-coefficients
2 12 Handling of cross-posted questions when
flagged
Share Cite Edit Follow edited Dec 9 '14 at 14:50 asked Dec 9 '14 at 14:43
Sycorax ♦ Tim Linked
64.3k 18 157 272 51 1 1 3
0 Covariance between estimates of slope
and intercept
5 Assuming you are referring to the estimates of the coefficients and not the coefficients themselves, the 45 How to derive variance-covariance matrix
possible values are all real numbers. This becomes obvious once you realize that it is possible for this
of coefficients in linear regression
covariance to be either zero or nonzero and that changing the units of measurement of the two variables
can rescale the covariance by any real number. Let's address your first question, then: what kind of 1 What is the meaning of correlations
"understanding" do you seek? We have much useful material here on understanding covariance and on between regression coefficients?
understanding statistical estimates, all accessible through the site search. – whuber ♦ Dec 9 '14 at 16:38

add a comment Related

6 Covariance term in simple linear regression

1 Answer Active Oldest Votes
1 In simple linear regression, what is the
covariance between the error term and the
To answer your question as asked, if you adopt the frequentist view of statistics then 𝛽0 and 𝛽1 are residual?
not random variables and thus have no covariance. They are fixed (and unobserved) values that 0 About simple linear regression
7 describe the true relationship between your 𝑌 and 𝑋 variables. The covariance between them is
undefined in the sense that the covariance between 4.5 and 𝜋 is undefined; they're not random 0 Confusion regarding Least
Square/Maximum Likelihood estimators
variables, they're just numbers. If you adopt the Bayesian view of statistics, and you thus view 𝛽0 under a restricted intercept?
and 𝛽1 as random variables themselves, I imagine you could model them as covarying somehow.
Maybe someone can elaborate on this in the comments as I'm not really sure of this. Hot Network Questions
However, I suspect you're asking something different; namely, what is the covariance between the What one should check when re writing bash
^ ^ conditions for sh or ash?
estimates of these coefficients (sometimes called 𝛽0 and 𝛽1 , sometimes called 𝑏0 and 𝑏1 ). This is
Was there ever any actual Spaceballs
answered very well by the top answer here. If you look at the off-diagonal elements of the variance- merchandise?
covariance matrix of the estimates (equation 6.78a in the textbook the OP posted), you will see
Is there a crosswind that would perfectly cancel
out the "torque" of a C172 on takeoff?
−𝑋¯ 𝜎2
Cov(𝛽^0 , 𝛽^1 ) = ¯ Var(𝛽^1 )
= −𝑋 Strictly speaking, are 重箱読み and 湯桶読み
∑ (𝑋𝑖 − 𝑋 ¯ )2 mostly 漢語 or 和語, or 50-50?

How did I lose a city?

where 𝜎 2 is the variance of the error terms.
What is the largest single file that can be loaded
into a Commodore C128?
To answer your question of what range of values it can take on, let's look at the equation. This
equation shows that as the spread of 𝑋 values increases, the magnitude of the covariance Is it normal to feel like I can't breathe while trying
to ride at a challenging pace?
decreases (ie, as the denominator gets larger, the expression gets smaller in magnitude). As the
What game features this yellow-themed living
error term variance 𝜎 2 increases, so does the magnitude of the covariance. Additionally, the sign room with a spiral staircase?
¯.
of the covariance is the opposite sign of 𝑋 How many descendants can this spaceship crew
produce?
¯
So it can actually take on any range of values from −∞ to 0 if 𝑋 > 0 and any range of values Are there any alternatives to the handshake
¯ < 0 . The magnitude of the value it takes on depends on the spread of your 𝑋
from 0 to ∞ if 𝑋 worldwide?
values and the variance of your error terms. What would make a plant's leaves razor-sharp?

^
¯ Var(𝛽1 ) in the equation to further help with intuition. The variance of our slope
What sort of work environment would require both
edit: I added −𝑋 an electronic engineer and an anthropologist?
^
estimate, Var(𝛽1 ) , is a measure of how precise that estimate is; in a perfect world, we want this Ceramic resonator changes and maintains
frequency when touched
variance to be small so that our estimate is very precise. In light of this, I don't really think that the
Realistic task for teaching bit operations
covariance between the intercept and slope estimates is a very useful or enlightening concept on
its own. As far as I can tell, it is the negative of the product of two more easy-to-interpret values: 𝑋 ¯ How to find out if a preprint has been already
^ published
and Var(𝛽1 ) .
Are such functions differentiable?

Share Cite Edit Follow How to calculate charge analysis for a molecule
edited Apr 13 '17 at 12:44 answered Dec 9 '14 at 17:00
Community ♦ eithompson Is it possible for planetary rings to be
1 156 9 perpendicular (or near perpendicular) to the
planet's orbit around the host star?
add a comment
How will NASA set Perseverance to enter the
atmosphere of Mars at the right location after
traveling 7 months in space?
Your Answer
more hot questions

Question feed

Links Images Styling/Headers Lists Blockquotes Code HTML Tables Advanced help

Post Your Answer

Not the answer you're looking for? Browse other questions tagged covariance regression-coefficients or
ask your own question.

CROSS VALIDATED COMPANY STACK EXCHANGE Blog Facebook Twitter LinkedIn Instagram
NETWORK
Tour Stack Overflow
Technology
Help For Teams
Life / Arts
Chat Advertise With Us
Culture / Recreation
Contact Hire a Developer
Science
Feedback Developer Jobs
Other
Mobile About
Disable Responsiveness Press
Legal
Privacy Policy
site design / logo © 2021 Stack Exchange Inc; user contributions licensed
Terms of Service under cc by-sa. rev 2021.1.11.38289