ECTS @ IUE ECTS @ IUE ECTS @ IUE ECTS @ IUE ECTS @ IUE ECTS @ IUE ECTS @ IUE

Syllabus ( ELEC 633 )


   Basic information
Course title: Information Theory
Course code: ELEC 633
Lecturer: Prof. Dr. Oğuz KUCUR
ECTS credits: 7.5
GTU credits: 3 (3+0+0)
Year, Semester: 1, Fall and Spring
Level of course: Second Cycle (Master's)
Type of course: Area Elective
Language of instruction: Turkish
Mode of delivery: Face to face
Pre- and co-requisites: Undergraduate level probability (ELEC218) and digital communications (ELEC365) knowledge.
Professional practice: No
Purpose of the course: Understanding the basics of the information and coding theory.
   Learning outcomes Up

Upon successful completion of this course, students will be able to:

  1. Understand the basics of information theory.

    Contribution to Program Outcomes

    1. Define and manipulate advanced concepts of Electronics Engineering
    2. Formulate and solve advanced engineering problems
    3. Acquire scientific knowledge
    4. Find out new methods to improve his/her knowledge

    Method of assessment

    1. Written exam
    2. Homework assignment
  2. Have a deeper insight of the communication applications, based on information theory.

    Contribution to Program Outcomes

    1. Define and manipulate advanced concepts of Electronics Engineering
    2. Formulate and solve advanced engineering problems
    3. Acquire scientific knowledge
    4. Develop an awareness of continuous learning in relation with modern technology

    Method of assessment

    1. Written exam
    2. Homework assignment
  3. Learn source coding, channel capacity and error correcting codes.

    Contribution to Program Outcomes

    1. Define and manipulate advanced concepts of Electronics Engineering
    2. Formulate and solve advanced engineering problems
    3. Acquire scientific knowledge
    4. Develop an awareness of continuous learning in relation with modern technology

    Method of assessment

    1. Written exam
    2. Homework assignment
    3. Term paper
   Contents Up
Week 1: Introduction, measure of information, entropy.
Week 2: Lossless source coding: Variable length source coding.
Week 3: Lossless source coding: Huffman coding, Lempel-Ziv algorithm.
Week 4: Lossy data compression.
Week 5: Channel models and channel capacity.
Week 6: Channel models and channel capacity (Cont.)
Week 7: Channel reliability function, channel cutoff rate.
Week 8: Midterm exam, introduction to error control coding.
Week 9: Linear block codes.
Week 10: Hard and soft decision of linear block codes. Block and bit error probability of linear block codes.
Week 11: Cyclic codes; BCH and RS codes.
Week 12: Convolutional codes.
Week 13: Decoding of convolutional codes: Viterbi algorithm.
Week 14: Probability of error for convolutional codes. Introduction to Turbo coding and iterative decoding.
Week 15*: -
Week 16*: Fınal exam.
Textbooks and materials: Digital Communications, J. G. Proakis, M. Salehi, McGraw-Hill, 5th Ed.
Recommended readings: Elements of Information Theory, T. M. Cover, J. A. Thomas, Wiley-Interscience, 2006, 2nd ed.
Information Theory and Reliable Communication, R. Gallager, Wiley, 1991, ISBN: 978-0-471-29048-3.
Principles and Practice of Information Theory, R. E. Blahut, Addison-Wesley, 1990.
Error Control Coding : Fundamentals and Applications, S. Lin, D. J. Costello, Pearson, 2004, 2nd Ed., ISBN 13: 9780130426727.
Principles of Digital Communications, A. J. Viterbi, J. K. Omura, McGraw-Hill, 1979.
Applied Coding and Information Theory for Engineers, R.B. Wells, Prentice-Hall, 1999.
Error Control Systems for Digital Communication and Storage, S. B. Wicker, Englewood Cliffs: Prentice Hall, 1995.

  * Between 15th and 16th weeks is there a free week for students to prepare for final exam.
Assessment Up
Method of assessment Week number Weight (%)
Mid-terms: 8 30
Other in-term studies: 0 0
Project: 10, 13 20
Homework: 2,4, 6, 8, 10, 12 10
Quiz: 0 0
Final exam: 16 40
  Total weight:
(%)
   Workload Up
Activity Duration (Hours per week) Total number of weeks Total hours in term
Courses (Face-to-face teaching): 3 14
Own studies outside class: 4 14
Practice, Recitation: 0 0
Homework: 6 6
Term project: 10 2
Term project presentation: 0 0
Quiz: 0 0
Own study for mid-term exam: 15 1
Mid-term: 3 1
Personal studies for final exam: 15 1
Final exam: 3 1
    Total workload:
    Total ECTS credits:
*
  * ECTS credit is calculated by dividing total workload by 25.
(1 ECTS = 25 work hours)
-->