Convolutional Codes-Digital Communication Systems-Lecture Slides, Slides of Digital Communication Systems

Dr. Shurjeel Wyne delivered this lecture at COMSATS Institute of Information Technology, Attock for Digital Communication Systems course. In this he discussed: Convolutional, State, Diagram, Trellis, Representation, Maximum, Likelihood, Soft, Hard, Decisions

Typology: Slides

2011/2012

Uploaded on 07/05/2012

nomi
nomi 🇵🇰

4.3

(22)

24 documents

1 / 10

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
1
1
Digital Communication
Systems
Dr. Shurjeel Wyne
Lecture 16
CH 7 Convolutional Codes
2
Last time, we talked about:
A class of linear codes known as
Convolutional codes.
We studied the structure of the encoder and
different ways for representing it.
pf3
pf4
pf5
pf8
pf9
pfa

Partial preview of the text

Download Convolutional Codes-Digital Communication Systems-Lecture Slides and more Slides Digital Communication Systems in PDF only on Docsity!

1

Digital Communication

Systems

Dr. Shurjeel Wyne

Lecture 16

CH 7 Convolutional Codes

2

Last time, we talked about:

 A class of linear codes known as

Convolutional codes.

 We studied the structure of the encoder and

different ways for representing it.

3

Today, we are going to talk

about:

 What are the state diagram and trellis

representation of the code?

 How the decoding is performed for

Convolutional codes?

 What is a Maximum likelihood decoder?

 What are the soft decisions and hard

decisions?

 How does the Viterbi algorithm work?

4

State diagram

 A convolutional encoder belongs to a class of

devices known as finite-state machines

 A finite-state machine only encounters a finite

number of states.

 State of a machine: the smallest amount of

information that, together with a current input to the

machine, can predict the output of the machine.

 In a Convolutional encoder, the state is represented

by the contents of the memory, i.e., the right-most

K-1 stages of the shift register.

 Consequently, there are 2(K-1)^ possible states of the

encoder.

7

Trellis Diagram

 Trellis diagram is an extension of the state

diagram that shows the passage of time.

 Example of a section of trellis for the rate ½ code, K =
t i ti  1 Time

State S 0  00

S 1  01

S 2  10

S 3  11

m

u 1

u 2

u 1 u 2

  • The nodes of the trellis characterize the possible encoder states
  • At each unit of time, the trellis requires 2(K-1)^ nodes to represent the 2 (K-1)^ possible encoder states
  • Transitions are represented by the lines labelled a/b 1 b 2

Input bit 0 Input bit 1

(K-1) = Numb. Of memory elements

8

Encoder Trellis Diagram (at TX)

t (^) 1 t (^) 2 t (^) 3 t (^) 4 t 5 t 6

1 0 1 0 0

11 10 00 10 11

Input bits

Output bits

Tail bits

S 0  00

S 1  01

S 2  10

S 3  11

Input bit 0 Input bit 1

(view code symbol sequence against time, for a given message sequence)

9

Optimum decoding

 If the possible input message sequences are equally likely, the optimum decoder which minimizes the probability of error is the Maximum likelihood decoder.

 The ML decoder, chooses a particular codeword U ( m ´)^ as the transmitted sequence if the likelihood p ( Z| U ( m ´)^ ) is greater than the likelihoods of all the other possible transmitted sequences, where Z is the demodulated (still encoded) sequence input to the decoder

Choose if ( ) max ( () )

overall

( m ) p ( m ) p m
U Z|U  U (m) Z|U

 

ML decoding rule:

codewords to search for an L-bit message sequence

Mathematically: 2^ L

10

ML decoding for memory-less channels

 Due to the independent channel statistics for memoryless
channels, the likelihood function becomes
and equivalently, the log-likelihood function becomes

 The path metric up to time index , is called the partial path metric.

 

  

 

   1 1

() 1

() () , ,...,,... 1 2 ( (^ )) ( , ,..., ,...| ) ( | ) ( | ) (^12) i

n j

m ji ji i

m i i m zz z i p m^ p Z Z Z U pZ U pz u Z| U i

 

 

1 1

() 1

( ) log ( (^ )) log ( | ()) log ( | ) i

n

j

m ji ji i

m i i m p Z|U m^ pZ U pz u  U Path metric Branch metric (^) Bit metric

ML decoding rule: Choose the path with maximum metric (likelihood) among all the paths in the trellis.

This path is the “closest” path to the transmitted sequence, in other words the ML decoding rule chooses, as its estimate of the transmitted sequence, the path that has minimum distance to the received sequence

" i "

Note: read articles 7.3 --- 7.3.4 from Sklar textbook

zji =demodulator output symbol corresponding to j -th code symbol of i -th branch word

13

 In Soft decision decoding:

 The demodulator does not assign a ‘0’ or a ‘1’ to each received bit, zji , rather each value of z(T) is quantized to more than two levels.  The demodulator provides the decoder with some side information together with the decision, where the side information provides the decoder with a measure of confidence for the decision.  The demodulator outputs, quantized to more than two levels, are called soft-bit

 Decoding based on soft-bits, is called the “soft-decision
decoding”.
 Euclidean distance is used as the distance metric
 On AWGN channels, 2 dB and on fading channels 6 dB gain
are obtained by using soft-decoding over hard-decoding.

Soft and hard decision decoding…

14

(3-bit quantization)

When the demodulator sends a soft binary decision, quantized to eight levels, it sends the decoder a 3-bit word describing an interval along z(T)

When the demodulator sends a hard binary decision to the decoder, it sends the decoder a single binary symbol

Soft and hard decision decoding –

Cont’d

Example: BPSK modulation with hard decision and 3-bit quantized soft decision decoding

15

The Viterbi algorithm (VA)

 The Viterbi algorithm performs Maximum likelihood
decoding, i.e., the decoder block is a Viterbi decoder
 The VA finds a path through the trellis with the largest
metric (maximum correlation or minimum distance).

 It processes the demodulator outputs in an iterative manner.  At each step in the trellis, it compares the metric of all paths entering each state, and keeps only the path with the largest metric, called the survivor, together with its metric.  It proceeds in the trellis by eliminating the least likely paths.

 It reduces the decoding complexity relative to brute-force
maximimum likelihood search for the transmitted codeword
among 2L^ codewords.

16

The Viterbi algorithm - cont’d

 Viterbi algorithm:

A. Do the following set up:

 For a data block of L bits, form the trellis. The trellis has L+K-1 sections, it starts at time and ends up at time  Label all the branches in the trellis with their corresponding branch metric.  For each state in the trellis at the time which is denoted by , define a parameter

t i S ( ti )  { 0 , 1 ,..., 2 K ^1 } ^ S^ ( ti ), ti

t 1 t L  K

19

Example of Hard decision

Viterbi decoding-cont’d

 Label all the branches with the branch metric (Hamming distance)

t (^) 1 t (^) 2 t (^) 3 t (^) 4 t 5 t 6

0

  S ( ti ), ti11 00 10 10 01

Z

S 0  00

S 1  01

S 2  10

S 3 (^)  11

Branch metric