Asymptotic Notation - Introduction to Algorithms - Lecture Notes, Study notes of Algorithms and Programming

Key points of this lecture are: Asymptotic Notation, O-Notation, Upper Bounds, Properties, Solving Recurrences, Iteration Method, Master Method, Tight Bounds.

Typology: Study notes

2011/2012

Uploaded on 10/25/2012

ramprasad
ramprasad 🇮🇳

4.3

(28)

119 documents

1 / 9

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
! " # $
% & ' ! $
' ( ) * ( + # ( " ! , - " ! . " / & $
0 1
2 3 4 ! " ! * 5 ( " ! # ! * " ( , 6 7 8 7 9
: ;
< ( * ! * " (
: =
# >
:
% " 4 ! *
" ) * ( > 5 ( 5
: ?
! # ! * " ( 3 ! + "
:
@ ! * ! ! * " ( 3 ! + "
: A
# ! 3 ! + "
B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O TN X Y Z [ \ ] D X R O Z Q ^ _ ` a b c O R ^ O _ L ` d G G K e ^ W b K
f
1
1
1
6 g ( " ! # ! * " ( h 4 4 @ " ( i
: j
h k i l 6 h m h k i i * . n 5 " ( ! o 7 k p 5 + ! + # !
q r
j
h k i
r
o m h k i 7 s k t k p $
:
$ > $ u k v l 6 h k w i h o l & 7 k p l u i
x
l * . ( ( y " ( g z # { | # ) * !
x
k v } k w # . ( 5 ! * " ( } ( " ! # ) }
@ ! z * ! * ( > 5 # . ) ) * ! " " ! * " $
~
+ 6 g ( " ! # ! * " ( * ) " 4 4 } @ ! 5 " ( ( * ( ! $
B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O TN X Y Z [ \ ] D X R O Z Q ^ _ ` a b c O R ^ O _ L ` d G G K e ^ W b d
~
+ " > + @ * ( > ) " 4 4 } 3 ! ( ! # ( z + # !
6 g ( " ! # ! * " ( 3 # ( $
~
+ * ( " . 6 h m h k i i # # " . . ( 5 ! * " ( ,
6 h m h k i i l
j
h k i , n 5 " ( ! o 7 k p
5 + ! + # !
q r
j
h k i
r
o m h k i 7 s k t k p
~
+ ( u k v 6 h k w i
B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O TN X Y Z [ \ ] D X R O Z Q ^ _ ` a b c O R ^ O _ L ` d G G K e ^ W b
f
j
h k i l k v 6 h k i 3 # (
j
h k i l k v h k i . " " 3 h k i 6 h k i
,
6 g ( " ! # ! * " ( * # (
( " ! # ! * " ( $
A
# ( " ( ! " #
j
h k i * # ! ) # ! 6 h k i $
B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O TN X Y Z [ \ ] D X R O Z Q ^ _ ` a b c O R ^ O _ L ` d G G K e ^ W b H
pf3
pf4
pf5
pf8
pf9

Partial preview of the text

Download Asymptotic Notation - Introduction to Algorithms - Lecture Notes and more Study notes Algorithms and Programming in PDF only on Docsity!

: % "^4 !*

: A

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbK

   f  1    1    1 

 6 g( " !# !*" ( h 4 4  @ " ( i

: j hk i l^6 hm hk ii *. n^5 " ( ! o^7 k p ^5 + !+ #!

q r j

hk i

r om hk i 7 s k t k p $

 $> $ u k v l 6 hk wi ho l & 7 k p l u i

x l  . ( (  y" ( gz # { |  # )!

x k v} k w #  . ( 5 !*" ( } ( "!  #) }

@ ! z !( > 5 # . )) * !" " ! *"  $

  •   6 g( "!# !*" ( * )" 4 4  } @ ! 5 " (  ( * (! $

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^Wbd

  • "  > + @ *( > )" 4 4 } 3  !  ( !# ( z + #!

6 g( " !# !*" ( €‚‚ƒ 3 # ( $

  • ( „ ". 6 hm hk ii #  # € † ". . ( 5 !"( ,

6 hm hk ii l ‡ j

hk i , n 5 " ( ! o 7 k p

q r

j

hk i

r om hk i 7 s k t k p ˆ

  • ( u k v ‰ 6 hk wi

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbŠ

‹ Œ  f 

j

hk i l k v Ž 6 hk i 3 #( 

j hk i l k v Ž  hk i ." "^3   hk i ‰^6 hk i

6 g( " !#!*" ( * # ( “ ” ” €•–

A

j

hk i * #! ) #! 6 hk i$

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbH

8 hm hk ii l ‡ j

hk i , n o 7 k p  5 + !+ #!

q r om hk i

r j

hk i 7 s k t k pˆ 

 $> $ k l 8 h)> k i ho l & 7 k p l &¡ i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^Wb¢

9 hm hk ii l ‡ j

hk i , n o ¤ 7 o

v

7 k p  5 + !+ #!

q r o ¤m hk i

r j

hk i

r o

v

m hk i 7 s k t k pˆ 

u

k v Ž uk l 9 hk vi

q r

k v

r

u

k v Ž u k

r ¦

k v

q r

k

r

u

k Ž u

r ¦

k

q r k

r uk Ž §

r

k

uk Ž §

r

k

r k ho ¤ l &¨

7 o

v

l

¦

7 k p l § i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbE

  • " 3 &, / # *( > 5 "( !#( ! #( )"z g"    ! 3 

" ( ©! 3 #!!$ h 2  ª !  ( *( « # 3 4 )$i

 !< 5 #!" ( h( "! 4 " ".}ª ! + #( z # *( > i,

  • *> + g"  !  3 z # 3 4 "!+  ! 3 $
  • " 3 u , h 6 # ( 8 i ® 9 

h/ .! #  ¯#)) #  ° «  5 * $i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^Wb±

h)# ( # .z !* 5 „ μi

h 3 " ! > ( # )i

u $º

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbL

Ï 1      Ð  1 1 »

# , Ñ †€— Ò †Ó €— (  5 !  +  4 " !+ * @ 

“ –† Ԇ՗ Ò ‚

’ Ö

˜ €  †€ × ,

h¾ i

r o ¤¾ v À o

v

¾ ."  ¾ ¿ k

hk i l

hk ¨ u i Ž k

r ¥ ho¤hk ¨ uiv À o

v

hk ¨ uii Ž k

l o¤k v À u o

v

k Ž k

l o¤k v À o

v

k À ho

v

k À k i

r o¤k v À o

v

k *. o

v

t &

% * 5 „ o¤ @ *> ( " > + !" + #( ) *( !# ) 5 " ( !" (  $

(    @ !! !" ( 3 !+ " ."  )" z  h 8 i @ "  ( $

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbKŠ

h 5 " (  ! !"  3 3 # !*" ( i

Ø

hk i l k Ž

hk ¨ u i

l k Ž

hk ¨ u Ž

hk ¨

ii

l k Ž

hk ¨ u Ž

hk ¨

hk ¨ § iii

l k Ž

hk ¨ u Ž

hk ¨

hk ¨§ Ž

hk ¨ &¡ iii

l k Ž u k Ž

k Ž Ù ÙÙ Ž uÚÛ Ü

h&i

u ÚÛ Ü l k

l k

ÁÂ

Â

ÂÃ

ÚÛ Ü Ý

Þ

ß à p

u

ß ÄÅ Å Å Æ

Ž 9 hk i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbKH

l k

ÁÂ

Â

ÂÃ

ÚÛ Ü Ý

Þ

ß à p

u

ß ÄÅ Å Å Æ

Ž 9 hk i

/ " " „  4 , Þá

ßà p â

ß

l

â

áã

À &

â

À &

â ä

l &

l k

ÁÂ

Â

Â

Â

ÂÃ

uÚÛ Ü À &

u À &

ÄÅ

Å

Å

Å

Å

Æ

Ž 9 hk i

l 9 hk vi Ž 9 hk i

l 9 hk vi

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbK¢

  + "  ) „ ( " z  ) # ( + # ( ! !" ( ."  # !+ 3 !* 5

#( > " 3 !* 5  h)„  * *( !+  « # 3 4 )i$

A

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbKE

³      1        å  £     1 

hk i l

hk ¨

i Ž

hk ¨ u i Ž k v ,

n

2

T ( 4

1 n )

T ( 2

1 n )

T ( 8

1 n )

T ( 16

1 n )

( 4

1 n )

2

( 16

1 n )

2

( 2

1 n )

2

( 8

1 n )

2

16

5 n

2

256

25 n

2

Θ( n

2 )

( 16

5 )

3

n

2

n

2

T ( 4

1 n )

( 4

1 n )

2

( 2

1 n )

2

T ( 8

1 n )

n

2

n

2

( 8

1 n )

2

( 4

1 n )

2

geometric

h k i l k v h & Ž æ ¤ ç

Ž h æ ¤ ç

i v Ž Ù Ù Ù i l

¤ ç

k v l 9 h k v i

B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O T N X Y Z [ \ ] D X R O Z Q ^ _ a b c O R ^ O _ L d G G K e ^ W b K ±

h k i l

h k ¨

¦

i Ž

h u k ¨

¦

i Ž k ,

Î

9

n

9

2 n

9

2 n

9

4 n

n

3

n

3

2 n

n

n

n

Total: O ( n lg n )

log 3/

n

B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O T N X Y Z [ \ ] D X R O Z Q ^ _ a b c O R ^ O _ L d G G K e ^ W b K L

è " 

h k i l é

h k ¨ ê i Ž j

h k i }

é t

q

( ê Ê

q } # ( j #   3 4! "! * 5 # ) )  4 "  *! *  

h k i *    (! * 3 . "  # ( # ) > "  *! + 3 ë

*! ©   ( „ ( " z ( } @ ! z  " „ ( " z! + #! ,

 é   @ 4  " @ )  3  ".  * ì  k ¨ ê #    " )     5    *   )  }

h k ¨ ê i $

j

h k i * ! +  5 " ! ". *  * * ( > 4  " @ )  3 h @ . "   + # ( i

( 5 " 3 @ * ( * ( >! +      )!  h #.!   z #  i $

B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O T N X Y Z [ \ ] D X R O Z Q ^ _ a b c O R ^ O _ L d G G K e ^ W b K Ç

Î

h k i l é

h k ¨ ê i Ž j h k i ,

f ( n )

a

a

f ( n / b )

f ( n / b

2 ) f ( n / b

2 ) f ( n / b

2 )

a

f ( n / b )

f ( n / b

2 ) f ( n / b

2 ) f ( n / b

2 )

a

f ( n / b )

f ( n / b

2 ) f ( n / b

2 ) f ( n / b

2 )

n

log b a

Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1) Θ(1)

log b

n

f ( n )

a f ( n / b )

a

2 f ( n / b

2 )

Θ( n

log b a )

Total: Θ( n

log b a ) +^ ∑

j =

log b

n

a

j f ( n / b

j )

a

a

a

a

a

a

a

a

a

B C D E F G H E I J K L F H K G C M N O P Q R S N T P M N P U V W P O T N X Y Z [ \ ] D X R O Z Q ^ _ a b c O R ^ O _ L d G G K e ^ W b d G

     1 » Ï    

ÚîÛïÜ Ý

Þ

ò à p

é

ò

j

hk ¨ ê

ò

i l 6

ÁÂ

Â

ÂÃ

ÚîÛï Ü Ý

Þ

ò à p

é

ò

h

k

ê

ò

i

ÚîÛï ð Ý ô ÄÅ Å Å Æ

l 6

ÁÂ

Â

Â

Â

ÂÃ

k ÚîÛï ð Ý ô Þ

ò

h

é êô

êÚîÛï ð

i

ò

ÄÅ

Å

Å

Å

Å

Æ

l 6

ÁÂ

Â

ÂÃ

k ÚîÛï ð Ý ô Þ

ò

êô

ò ÄÅ Å Å Æ

l 6

ÁÂ

Â

Â

Â

ÂÃ

k ÚîÛï ð Ý ô

ÁÂ

Â

Â

Â

ÂÃ

êô ÚîÛïÜ À &

ê À &

ÄÅ

Å

Å

Å

Å

Æ

ÄÅ

Å

Å

Å

Å

Æ

l 6 Á

Ã

k ÚîÛï ðÄ Æ

Ë

  •   #> # *( z   

ø

Þ

ßà p â

ß

l

â

Ü

ã

À &

â

À &

hk i l (^6) Á

Ã

k ÚîÛïð ÄÆ

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^Wbd¢

Ï    

j hk i l^9 hk ÚîÛï ð )>

ß

k i} ."  " 3  5 " ( !#(! ¾ t

q

j

hk i #( k ÚîÛï ð # 3 

!" z *!+ ( # 4 ") )" > # !+ 3 * 5 .# 5 !"

Ë

> +!  5 #  h# !+ 3 !* 5 # )) *. ¾ l

q i

hk i l 9 hk ÚîÛï ð )>

ß

ã

k i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbdE

Ï  ù 

j hk i l^8 hk ÚîÛï ð ã

ôi ."  " 3  5 " ( !# (! õ Ê

q

)" } (  y> )# *! 5 " ( !" ( { ,

n o ¿ & # ( k p Ê

q $!$ é j

hk ¨ êi

r o j

hk i s k Ê k p

j

hk i > "z  4 ") ( " 3 *# )) .# ! !+ #( k ÚîÛïð

Ë

Î

" "! 5 " ( !#(  5 "( !#(! .# 5 !" ( ". !" !#) z *> +!

h*$$} !"!# )  5 " ( !#(! ö z > +! ". " " !i

hk i l 9 h j

hk ii

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^Wbd±

hk i l é

hk ¨ êi Ž j

hk i

& $ j hk i l 6 hk ÚîÛï ðÝ ôi

ú

hk i l (^6) Á

Ã

k ÚîÛïð ÄÆ

u $ j

hk i l 9 hk ÚîÛï ð )>

ß

k i ."  " 3  ¾ t

q

ú

hk i l 9 hk ÚîÛï ð )>

ß

ã

k i

j

hk i l 8 hk ÚîÛïð ã

ôi #(

é j

hk ¨ êi

r o j

hk i ú ." " 3  o ¿ & 7 k Ê k p

ú

hk i l 9 h j

hk ii

. ), 3 #! 3 !+ " 5 # ( ©! " )  €û €ƒ

 5   ( 5  ". !+ * ."  3 μ h

Ø

« # 3 4 )  )#!$i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbdL

¸ 0  Œ  f  

A

hk i l u

hk ¨ u i Ž 9 hk iëé l u 7 ê l u

k ÚîÛïð l k ÚîÛü v l k

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbdÇ

¸ 0  Œ  f  

A

hk i l u

hk ¨ u i Ž 9 hk iëé l u 7 ê l u

k ÚîÛï ð l k ÚîÛü v l k

9 hk i¨ k l 9 h&i l 9 h)>

p

k i

ú #  u } z *!+ ¾ l q

hk i l 9 hk ÚîÛï ð )>

ß

ã

k i l 9 hk )> k i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbŠG

¸ 0  Œ  f  

hk i l ý

hk ¨ u i Ž 9 hk vi

h

Î

 5   ( 5  ."   !# ( 2 )> " *!+ 3 } ( «! ) 5 ! i

k ÚîÛïð l k ÚîÛü þ l k ÚÛ þ

9 hk vi¨ k ÚÛ þ l 9 hk vÝ ÚÛ þi l 6 hk Ý ÿi

ú #  &

hk i l 9 hk ÚÛ þi

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbŠK

¸ 0  Œ  f  

 *( # 

h( "! "! μi,

hk i l

hk ¨ u i Ž 9 h& iëhé l & 7 ê l u i

k ÚÛ

l k

p

l &

9 h&i¨ & l 9 h)>

p

k i

ú

 u

hk i l 9 h)> k i

BCD EFGHEIJKLFHKGCMNOPQRSNTPMNPUVWPOTNXYZ []DXROZQ^_abcOR^O_LdGGK e^WbŠd