Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
An overview of the least squares regression algorithm, a popular machine learning technique used for approximating a line or a plane to fit a set of data points. The algorithm aims to minimize the sum of the squared differences between the predicted and actual values. The mathematical derivation, the cost function, and the steps to implement the algorithm.
Typology: Study notes
1 / 29
This page cannot be seen from the preview
Don't miss anything!
!
"
$&%
' (
) *+
%
,-
" '. , /
0
' 1 ,-
23
45
67
68
93
:;
4 <
9 =
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ] GZ
)
;
93
9
;
;
3
;
(^4) =
93
67
;
9
9 =
93
=
45 3
=
93
7
5 =
=
6
4 ^3
7
6
67
; 3
40
=
<
9
7
6
67
;
9
^0
9
93
6
6
;
7
=
3
9 1 1
3
6
6
4
1 <
9
43 3
9 <
9 6
67
;
9
!
(^4) =
4
!
9
;
4
5
43
=
93
1
=
9 ^3
=
6
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ] GA
7
;
9
%&
'(
5 =
=
9 =
93
9
^33
45
3
=
=
93
3
9
(^4) =
6
3
=
45 ;
(^93)
=
93
(^4) =
9 =
;
;
93
45
;
;
=
=
93 <
;
93
4 (^43)
=
9
9 =
9
9 =
93
9
9
3
;
93
;
6
9 =
93
9
3
9
93
=
9
9 =
9 ;
9
9 =
93
=
9 =
6
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ]
9 =
93
45
5
43
1
3
4
=
93
6
9 =
93
9
45
5
43
1
3
4
=
93
6
3
9
9
43
9 =
;
93
=
9
(^9)
4
=
93
9 =
93
43
6
9
9
^ :
4
9
9
9 =
9
45
3
=
=
93
0
9
9 =
93
9
=
6
4 3
9
=
9
(^3)
=
9 <
9 =
;
9 =
=
=
= 6 6 6 6 6 6 6 6
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ] EG
4
9 =
93
9
4 1
9
(^4)
9
; ; ;
;
;
; ;
; ;
;
;
;
5
43
6
9 =
93
(^93)
9 3
<
7
=
! "
$
%
&
!
!
'
!
(
(
"
) " * +
% +
!
)
,
+.-
,
,
,
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ] G B
!
1
3
=
45
=
;
4 ^3
6
4 ^3
=
93
45
=
=
9
=
6
7
3
9
=
9 93 <
9
43
45
9 1
9 =
;
(^4) =
=
=
=
^
^ ; 9 =
93
45
=
;
9
=
9 =
93
9
6
" " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " "
! " , ,
,
,
"
? @A B CA D DE
F
HG ?I JK GL JMN
OM K
HP
JGI
QRS GL R G CT LS U GI V
S
@J MN
WXXS LM S V
Y GR JP I GZ [ C
? ] G [
OM
MN
IJJE
(^1)
(^2)
(^3)
(^4)
(^5)
6
0 1 2 3 4 5
(^1)
(^2)
(^3)
(^4)
(^5)
6
0 10 20 30 40
(^1)
(^2)
(^3)
(^4)
(^5)
6
0 50
100150200250300350
OM
MN
IJJE
OM
MN
IJJE
OM
MN
IJJE
O
−
−0.
0
1
−0.8 −0.6 −0.4 −0. 0
0.2 0.4 0.6 0.
O
&
!
O
O
