EECE 577 Information and Coding Theory (Spring 2013)
offered by Dept. of Electronic and Electrical Eng, Pohang University of Science and Technology.
TTh 2:00pm - 3:15 pm at LG 106
Instructor: Professor Joon Ho Cho
Office) LG 419
E-mail) jcho at postech dot ac dot kr
Office Hours: by appointment
Eun Ae Lee
Ju Bum Kim
Office) LG 418
E-mail) euneh (at) postech.ac.kr
E-mail) wnqja321 (at) postech.ac.kr
- It is your responsibility to check every new announcement posted in the homepage.
- For your convenience, every class meeting will be recorded and uploaded on the course web page. In addition, a review video clip will be provided for every class.
- It is strongly recommended to watch the reviews before your attending the class meetings.
T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. NY: John Wiley and Sons, Inc., 2006.
- R. G. Gallager, Principles of Digital Communication, Chapters 1 to 3. Cambridge Univ. Press, 2008.
- R. G. Gallager, MIT 6.450 Principles of Digital Communications I, Lectures 1 to 7. YouTube: MIT OCW, 2006.
- R. W. Yeung, A First Course in Information Theory. NY: Kluwer Academic/Plemu Publishers, 2002.
- R. G. Gallager, Information Theory and Reliable Communication. NY: John Wiley and Sons Inc., 1968.
- A. E. Gamal and Y.-H. Kim, Network Information Theory.
Cambridge Univ. Press, 2012.
- D. J. C. MacKay, Information Theory, Inference, and Learning Algorithms. NY: Cambridge Univ. Press, 2003.
- To learn basic concepts in Information Theory
- To learn how to formulate and
- tackle Information-theoretical problems in communications and signal processing through the exposition to 4 main results in Information Theory
1. Zero-Error Data Compression
2. Source Coding Theorem
3. Shannon's Information Measures
4. Channel Coding Theorem
5. Rate Distortion Theory
- Undergraduate-level Signals and Systems
- Undergraduate- or graduate-level Digital Communications
- Undergraduate- or graduate-level Probability, Random Variable, and Random Processes
- (Estimation and Detection Theory)
Contact the instructor for questions about prerequisites.
1. 1st Midterm exam (Fri. 4/5, 7:30-12pm, LG 104, Lec. 1-9)
2. 2nd Midterm exam (Fri. 5/10, 7:30-12pm, LG 104, Lec. 1-21)
3. Final exam (Mon. 6/17, 7:30-12pm, LG 104, Lec. 1-34)
4. Homework (Quiz)
In each exam, a student is allowed to bring an A4-size crib sheet written on both sides.
Course participation is graded subjectively by the instructor based on the class absences, active participation in discussions, office hour visiting, voluntary projects, etc.
1. Homework will be assigned approximately every week but will not be collected.
2. Instead of collecting the homework, there will be a quiz at the beginning of the due date's recitation.
3. Scores will be normalized to assure proper weighting for each assignment.
4. Re-grade requests must be filed in writing within one week after the graded homework has been returned to students.
5. Only 30% of assigned problems per each assignment will be graded.
6. Each sub-problem will be graded according to the following scale: 100%, 60%, 20%, and 0%. So, you had better have a complete solution than an incomplete solution.
1. Students may take exams earlier than the original schedule if he/she requests at least one week earlier.
2. Excused class absence on an exam day may lead to a make-up exam for the absentee.
3. Re-grade requests must be filed in writing within one week after the graded exam has been returned to students.
4. Each sub-problem will be graded according to the following scale: 100%, 60%, 20%, and 0%. So, you had better have a complete solution than an incomplete solution.
Policy on Academic Dishonesty
If the instructor suspects academic dishonesty, the instructor will notify the student(s) and follow the procedure to report to the Graduate School without any exception. Students have the responsibility to be knowledgeable about the consequences of dishonesty.