Announcements             Syllabus             Schedule/Downloads


Syllabus

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Course Title:

EECE 577 Information and Coding Theory (Spring 2013)

offered by Dept. of Electronic and Electrical Eng, Pohang University of Science and Technology.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Class Meetings:

TTh 2:00pm - 3:15 pm at LG 106

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Instructor: Professor Joon Ho Cho

Office) LG 419

Phone) +82-54-279-2377

E-mail) jcho at postech dot ac dot kr

Office Hours: by appointment 

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif TAs:

Eun Ae Lee

Ju Bum Kim

Office) LG 418

Phone) +82-54-279-8017

E-mail)  euneh (at) postech.ac.kr

E-mail) wnqja321 (at) postech.ac.kr

 

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Homepage: https://cisl.postech.ac.kr/class/eece577/index.htm

  1.  It is your responsibility to check every new announcement posted in the homepage. 
  2. For your convenience, every class meeting will be recorded and uploaded on the course web page. In addition, a review video clip will be provided for every class.
  3. It is strongly recommended to watch the reviews before your attending the class meetings.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Text:  

T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. NY: John Wiley and Sons, Inc., 2006.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif References:

  1. R. G. Gallager, Principles of Digital Communication, Chapters 1 to 3. Cambridge Univ. Press, 2008.
  2. R. G. Gallager, MIT 6.450 Principles of Digital Communications I, Lectures 1 to 7. YouTube: MIT OCW, 2006.
  3. R. W. Yeung, A First Course in Information Theory. NY: Kluwer Academic/Plemu Publishers, 2002.
  4. R. G. Gallager, Information Theory and Reliable Communication. NY: John Wiley and Sons Inc., 1968.
  5. A. E. Gamal and Y.-H. Kim, Network Information Theory. Cambridge Univ. Press, 2012.
  6. D. J. C. MacKay, Information Theory, Inference, and Learning Algorithms. NY: Cambridge Univ. Press, 2003.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Course Objectives:  

  1. To learn basic concepts in Information Theory
  2. To learn how to formulate and
  3. tackle Information-theoretical problems in communications and signal processing through the exposition to 4 main results in Information Theory

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Course Outline

1.      Zero-Error Data Compression

2.      Source Coding Theorem

3.      Shannon's Information Measures

4.      Channel Coding Theorem

5.      Rate Distortion Theory

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Prerequisites:

  1. Undergraduate-level Signals and Systems
  2. Undergraduate- or graduate-level Digital Communications
  3. Undergraduate- or graduate-level Probability, Random Variable, and Random Processes
  4. (Estimation and Detection Theory)

Contact the instructor for questions about prerequisites.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Course Requirements:

1. 1st Midterm exam (Fri. 4/5, 7:30-12pm, LG 104, Lec. 1-9

15 %

2. 2nd Midterm exam (Fri. 5/10, 7:30-12pm, LG 104, Lec. 1-21

20 %

3. Final exam (Mon. 6/17, 7:30-12pm, LG 104, Lec. 1-34

35 %

4. Homework (Quiz)

20 %

5. Participation

10 %

100 %

In each exam, a student is allowed to bring an A4-size crib sheet written on both sides.  

Course participation is graded subjectively by the instructor based on the class absences, active participation in discussions, office hour visiting, voluntary projects, etc.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Grading Policies for Homework 

1.      Homework will be assigned approximately every week but will not be collected.  

2.      Instead of collecting the homework, there will be a quiz at the beginning of the due date's recitation.

3.      Scores will be normalized to assure proper weighting for each assignment. 

4.      Re-grade requests must be filed in writing within one week after the graded homework has been returned to students.

5.      Only 30% of assigned problems per each assignment will be graded. 

6.      Each sub-problem will be graded according to the following scale: 100%, 60%, 20%, and 0%. So, you had better have a complete solution than an incomplete solution.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Grading Policies for Exam 

1.      Students may take exams earlier than the original schedule if he/she requests at least one week earlier. 

2.      Excused class absence on an exam day may lead to a make-up exam for the absentee.

3.      Re-grade requests must be filed in writing within one week after the graded exam has been returned to students.

4.      Each sub-problem will be graded according to the following scale: 100%, 60%, 20%, and 0%. So, you had better have a complete solution than an incomplete solution.

http://www.postech.ac.kr/lab/ee/cisl/orange-ball.gif Policy on Academic Dishonesty

If the instructor suspects academic dishonesty, the instructor will notify the student(s) and follow the procedure to report to the Graduate School without any exception. Students have the responsibility to be knowledgeable about the consequences of dishonesty. 

03/05/13