Information Theory and Coding System

Basic objective of this lecture is to present Information Theory and Coding System. Main objective of a communication system is to convey information. Each message conveys some information where some message conveys more information than other. Here explain Information Theory in Information from intuitive point of view and Information from engineering point of view. Here also focus on Source Coding. Source Coding is the process by which data generated by a discrete source is represented efficiently called source coding. For example data compression.