Introduction to Information Theory and Data Compression, Second Edition

Author: Peter D. Johnson, Jr.,Greg A. Harris,D.C. Hankerson

Publisher: CRC Press

ISBN: 9781420035278

Category: Mathematics

Page: 384

View: 2690

An effective blend of carefully explained theory and practical applications, this text imparts the fundamentals of both information theory and data compression. Although the two topics are related, this unique text allows either topic to be presented independently, and it was specifically designed so that the data compression section requires no prior knowledge of information theory. The treatment of information theory, while theoretical and abstract, is quite elementary, making this text less daunting than many others. After presenting the fundamental definitions and results of the theory, the authors then apply the theory to memoryless, discrete channels with zeroth-order, one-state sources. The chapters on data compression acquaint students with a myriad of lossless compression methods and then introduce two lossy compression methods. Students emerge from this study competent in a wide range of techniques. The authors' presentation is highly practical but includes some important proofs, either in the text or in the exercises, so instructors can, if they choose, place more emphasis on the mathematics. Introduction to Information Theory and Data Compression, Second Edition is ideally suited for an upper-level or graduate course for students in mathematics, engineering, and computer science. Features: Expanded discussion of the historical and theoretical basis of information theory that builds a firm, intuitive grasp of the subject Reorganization of theoretical results along with new exercises, ranging from the routine to the more difficult, that reinforce students' ability to apply the definitions and results in specific situations. Simplified treatment of the algorithm(s) of Gallager and Knuth Discussion of the information rate of a code and the trade-off between error correction and information rate Treatment of probabilistic finite state source automata, including basic results, examples, references, and exercises Octave and MATLAB image compression codes included in an appendix for use with the exercises and projects involving transform methods Supplementary materials, including software, available for download from the authors' Web site at

Introduction to Combinatorics, Second Edition

Author: Walter D. Wallis,John C. George

Publisher: CRC Press

ISBN: 1498777627

Category: Mathematics

Page: 444

View: 7608

What Is Combinatorics Anyway? Broadly speaking, combinatorics is the branch of mathematics dealing with different ways of selecting objects from a set or arranging objects. It tries to answer two major kinds of questions, namely, counting questions: how many ways can a selection or arrangement be chosen with a particular set of properties; and structural questions: does there exist a selection or arrangement of objects with a particular set of properties? The authors have presented a text for students at all levels of preparation. For some, this will be the first course where the students see several real proofs. Others will have a good background in linear algebra, will have completed the calculus stream, and will have started abstract algebra. The text starts by briefly discussing several examples of typical combinatorial problems to give the reader a better idea of what the subject covers. The next chapters explore enumerative ideas and also probability. It then moves on to enumerative functions and the relations between them, and generating functions and recurrences., Important families of functions, or numbers and then theorems are presented. Brief introductions to computer algebra and group theory come next. Structures of particular interest in combinatorics: posets, graphs, codes, Latin squares, and experimental designs follow. The authors conclude with further discussion of the interaction between linear algebra and combinatorics. Features Two new chapters on probability and posets. Numerous new illustrations, exercises, and problems. More examples on current technology use A thorough focus on accuracy Three appendices: sets, induction and proof techniques, vectors and matrices, and biographies with historical notes, Flexible use of MapleTM and MathematicaTM

A Concise Introduction to Data Compression

Author: David Salomon

Publisher: Springer Science & Business Media

ISBN: 1848000723

Category: Computers

Page: 314

View: 3911

This clearly written book offers readers a succinct foundation to the most important topics in the field of data compression. Part I presents the basic approaches to data compression and describes a few popular techniques and methods that are commonly used to compress data. The reader will discover essential concepts. Part II concentrates on advanced techniques, such as arithmetic coding, orthogonal transforms, subband transforms and Burrows-Wheeler transform. This book is the perfect reference for advanced undergraduates in computer science and requires a minimum of mathematics. An author-maintained website provides errata and auxiliary material.

Mathematical Principles of the Internet, Volume 1


Author: Nirdosh Bhatnagar

Publisher: CRC Press

ISBN: 1351379143

Category: Computers

Page: 1022

View: 5771

This two-volume set on Mathematical Principles of the Internet provides a comprehensive overview of the mathematical principles of Internet engineering. The books do not aim to provide all of the mathematical foundations upon which the Internet is based. Instead, they cover a partial panorama and the key principles. Volume 1 explores Internet engineering, while the supporting mathematics is covered in Volume 2. The chapters on mathematics complement those on the engineering episodes, and an effort has been made to make this work succinct, yet self-contained. Elements of information theory, algebraic coding theory, cryptography, Internet traffic, dynamics and control of Internet congestion, and queueing theory are discussed. In addition, stochastic networks, graph-theoretic algorithms, application of game theory to the Internet, Internet economics, data mining and knowledge discovery, and quantum computation, communication, and cryptography are also discussed. In order to study the structure and function of the Internet, only a basic knowledge of number theory, abstract algebra, matrices and determinants, graph theory, geometry, analysis, optimization theory, probability theory, and stochastic processes, is required. These mathematical disciplines are defined and developed in the books to the extent that is needed to develop and justify their application to Internet engineering.

Introduction to Data Compression

Author: Khalid Sayood

Publisher: Morgan Kaufmann

ISBN: 9781558605589

Category: Computers

Page: 636

View: 626

The second edition of Introduction to Data Compression builds on the features that made the first the logical choice-for practitioners who need a comprehensive guide to compression for all types of multimedia and instructors who want to equip their students with solid foundations in these increasingly important and diverse techniques. This book provides an extensive introduction to the theory underlying today's compression techniques, with detailed, instruction for their application. All of the coverage has been updated to reflect the state of the art in data compression, including both new algorithms and older methods for which new uses are being found. And the downloadable software gives you the opportunity to see firsthand how various algorithms work, to choose and implement appropriate techniques in your own applications, and to build your own algorithms. * Fully updated to cover the most recent lossy and lossless compression techniques, including wavelets, subband coding, predictive lossless techniques, and Huffman coding variants. * Explains established and emerging standards in depth: JPEG 2000, JPEG-LS, MPEG 2, Group 3 and 4 Faxes, JBIG 2, ADPCM, LPC, CELP, and MELP. * Includes an new chapter providing the mathematical background required for understanding wavelets and subband coding. * Via the companion Web site, provides source code that enables you to experiment with a wide range of compression techniques, along with sample data and updates on the latest developments in the compression field.

Introduction to Combinatorial Designs, Second Edition

Author: W.D. Wallis

Publisher: Chapman and Hall/CRC

ISBN: 9781584888383

Category: Mathematics

Page: 328

View: 6181

Combinatorial theory is one of the fastest growing areas of modern mathematics. Focusing on a major part of this subject, Introduction to Combinatorial Designs, Second Edition provides a solid foundation in the classical areas of design theory as well as in more contemporary designs based on applications in a variety of fields. After an overview of basic concepts, the text introduces balanced designs and finite geometries. The author then delves into balanced incomplete block designs, covering difference methods, residual and derived designs, and resolvability. Following a chapter on the existence theorem of Bruck, Ryser, and Chowla, the book discusses Latin squares, one-factorizations, triple systems, Hadamard matrices, and Room squares. It concludes with a number of statistical applications of designs. Reflecting recent results in design theory and outlining several applications, this new edition of a standard text presents a comprehensive look at the combinatorial theory of experimental design. Suitable for a one-semester course or for self-study, it will prepare readers for further exploration in the field. To access supplemental materials for this volume, visit the author’s website at

Pearls of discrete mathematics

Author: Martin J. Erickson

Publisher: CRC

ISBN: 9781439816165

Category: Computers

Page: 270

View: 3380

This book presents intriguing examples, facts, theorems, and proofs from the world of discrete mathematics. The author presents special topics that are not found elsewhere, including the upward extension of Pascal's triangle, the problem of counting Rook paths and Queen paths, higher-dimensional tic-tac-toe, recurrence relations and generating functions, the pigeonhole principle, information theory and codes, and game theory. He also explores connections between discrete structures and other branches of mathematics, such as combinatorics and algebra. The text includes examples, exercises, and appendices containing Mathematica ® calculations and related Internet resources.

A Java Library of Graph Algorithms and Optimization

Author: Hang T. Lau

Publisher: Chapman and Hall/CRC


Category: Computers

Page: 386

View: 2566

Collecting some of the most popular graph algorithms and optimization procedures, A Java Library of Graph Algorithms and Optimization provides the source code for a library of Java programs that can be used to solve problems in graph theory and combinatorial optimization. Self-contained and largely independent, each topic starts with a problem description and an outline of the solution procedure, followed by its parameter list specification, source code, and a test example that illustrates the usage of the code. An accompanying CD-ROM contains all of the Java code included in the book.

Applications of abstract algebra with Maple and MATLAB

Author: Richard E. Klima,Neil Sigmon,Ernest Stitzinger

Publisher: CRC Press

ISBN: 9781584886105

Category: Computers

Page: 505

View: 2908

Eliminating the need for heavy number-crunching, sophisticated mathematical software packages open the door to areas like cryptography, coding theory, and combinatorics that are dependent on abstract algebra. Applications of Abstract Algebra with Maple and MATLAB®, Second Edition explores these topics and shows how to apply the software programs to abstract algebra and its related fields. Carefully integrating Maple and MATLAB®, this book provides an in-depth introduction to real-world abstract algebraic problems. The first chapter offers a concise and comprehensive review of prerequisite advanced mathematics. The next several chapters examine block designs, coding theory, and cryptography while the final chapters cover counting techniques, including Pólya's and Burnside's theorems. Other topics discussed include the Rivest, Shamir, and Adleman (RSA) cryptosystem, digital signatures, primes for security, and elliptic curve cryptosystems. New to the Second Edition Three new chapters on Vigenère ciphers, the Advanced Encryption Standard (AES), and graph theory as well as new MATLAB and Maple sections Expanded exercises and additional research exercises Maple and MATLAB files and functions available for download online and from a CD-ROM With the incorporation of MATLAB, this second edition further illuminates the topics discussed by eliminating extensive computations of abstract algebraic techniques. The clear organization of the book as well as the inclusion of two of the most respected mathematical software packages available make the book a useful tool for students, mathematicians, and computer scientists.

An Introduction to Kolmogorov Complexity and Its Applications

Author: Ming Li,Paul Vitanyi

Publisher: Springer Science & Business Media

ISBN: 9780387948683

Category: Mathematics

Page: 637

View: 7964

Briefly, we review the basic elements of computability theory and prob ability theory that are required. Finally, in order to place the subject in the appropriate historical and conceptual context we trace the main roots of Kolmogorov complexity. This way the stage is set for Chapters 2 and 3, where we introduce the notion of optimal effective descriptions of objects. The length of such a description (or the number of bits of information in it) is its Kolmogorov complexity. We treat all aspects of the elementary mathematical theory of Kolmogorov complexity. This body of knowledge may be called algo rithmic complexity theory. The theory of Martin-Lof tests for random ness of finite objects and infinite sequences is inextricably intertwined with the theory of Kolmogorov complexity and is completely treated. We also investigate the statistical properties of finite strings with high Kolmogorov complexity. Both of these topics are eminently useful in the applications part of the book. We also investigate the recursion theoretic properties of Kolmogorov complexity (relations with Godel's incompleteness result), and the Kolmogorov complexity version of infor mation theory, which we may call "algorithmic information theory" or "absolute information theory. " The treatment of algorithmic probability theory in Chapter 4 presup poses Sections 1. 6, 1. 11. 2, and Chapter 3 (at least Sections 3. 1 through 3. 4).

A Student's Guide to Coding and Information Theory

Author: Stefan M. Moser,Po-Ning Chen

Publisher: Cambridge University Press

ISBN: 1107601967

Category: Technology & Engineering

Page: 206

View: 9966

A concise, easy-to-read guide, introducing beginners to the engineering background of modern communication systems, from mobile phones to data storage. Assuming only basic knowledge of high-school mathematics and including many practical examples and exercises to aid understanding, this is ideal for anyone who needs a quick introduction to the subject.

Algorithmen - Eine Einführung

Author: Thomas H. Cormen,Charles E. Leiserson,Ronald Rivest,Clifford Stein

Publisher: Walter de Gruyter GmbH & Co KG

ISBN: 3110522012

Category: Computers

Page: 1339

View: 7563

Der "Cormen" bietet eine umfassende und vielseitige Einführung in das moderne Studium von Algorithmen. Es stellt viele Algorithmen Schritt für Schritt vor, behandelt sie detailliert und macht deren Entwurf und deren Analyse allen Leserschichten zugänglich. Sorgfältige Erklärungen zur notwendigen Mathematik helfen, die Analyse der Algorithmen zu verstehen. Den Autoren ist es dabei geglückt, Erklärungen elementar zu halten, ohne auf Tiefe oder mathematische Exaktheit zu verzichten. Jedes der weitgehend eigenständig gestalteten Kapitel stellt einen Algorithmus, eine Entwurfstechnik, ein Anwendungsgebiet oder ein verwandtes Thema vor. Algorithmen werden beschrieben und in Pseudocode entworfen, der für jeden lesbar sein sollte, der schon selbst ein wenig programmiert hat. Zahlreiche Abbildungen verdeutlichen, wie die Algorithmen arbeiten. Ebenfalls angesprochen werden Belange der Implementierung und andere technische Fragen, wobei, da Effizienz als Entwurfskriterium betont wird, die Ausführungen eine sorgfältige Analyse der Laufzeiten der Programme mit ein schließen. Über 1000 Übungen und Problemstellungen und ein umfangreiches Quellen- und Literaturverzeichnis komplettieren das Lehrbuch, dass durch das ganze Studium, aber auch noch danach als mathematisches Nachschlagewerk oder als technisches Handbuch nützlich ist. Für die dritte Auflage wurde das gesamte Buch aktualisiert. Die Änderungen sind vielfältig und umfassen insbesondere neue Kapitel, überarbeiteten Pseudocode, didaktische Verbesserungen und einen lebhafteren Schreibstil. So wurden etwa - neue Kapitel zu van-Emde-Boas-Bäume und mehrfädigen (engl.: multithreaded) Algorithmen aufgenommen, - das Kapitel zu Rekursionsgleichungen überarbeitet, sodass es nunmehr die Teile-und-Beherrsche-Methode besser abdeckt, - die Betrachtungen zu dynamischer Programmierung und Greedy-Algorithmen überarbeitet; Memoisation und der Begriff des Teilproblem-Graphen als eine Möglichkeit, die Laufzeit eines auf dynamischer Programmierung beruhender Algorithmus zu verstehen, werden eingeführt. - 100 neue Übungsaufgaben und 28 neue Problemstellungen ergänzt. Umfangreiches Dozentenmaterial (auf englisch) ist über die Website des US-Verlags verfügbar.

Data Compression

The Complete Reference

Author: David Salomon

Publisher: Springer Science & Business Media

ISBN: 1846286034

Category: Computers

Page: 1092

View: 6662

This book provides a comprehensive reference for the many different types and methods of compression. Included are a detailed and helpful taxonomy, analysis of most common methods, and discussions on the use and comparative benefits of methods and description of "how to" use them. Detailed descriptions and explanations of the most well-known and frequently used compression methods are covered in a self-contained fashion, with an accessible style and technical level for specialists and nonspecialists. Comments and suggestions of many readers have been included as a benefit to future readers, and a website is maintained and updated by the author.

A Short Course in Quantum Information Theory

An Approach From Theoretical Physics

Author: Lajos Diosi

Publisher: Springer

ISBN: 3642161170

Category: Computers

Page: 161

View: 6768

This short and concise primer takes the vantage point of theoretical physics and the unity of physics. It sets out to strip the burgeoning field of quantum information science to its basics by linking it to universal concepts in physics. An extensive lecture rather than a comprehensive textbook, this volume is based on courses delivered over several years to advanced undergraduate and beginning graduate students, but essentially it addresses anyone with a working knowledge of basic quantum physics. Readers will find these lectures a most adequate entry point for theoretical studies in this field. For the second edition, the authors has succeeded in adding many new topics while sticking to the conciseness of the overall approach. A new chapter on qubit thermodynamics has been added, while new sections and subsections have been incorporated in various chapter to deal with weak and time-continuous measurements, period-finding quantum algorithms and quantum error corrections. From the reviews of the first edition: "The best things about this book are its brevity and clarity. In around 100 pages it provides a tutorial introduction to quantum information theory, including problems and solutions. ... it’s worth a look if you want to quickly get up to speed with the language and central concepts of quantum information theory, including the background classical information theory." (Craig Savage, Australian Physics, Vol. 44 (2), 2007)

The Mobile Communications Handbook

Author: Jerry D. Gibson

Publisher: CRC Press

ISBN: 9781439874998

Category: Technology & Engineering

Page: 720

View: 8059

In a single volume, The Mobile Communications Handbook 2nd. Edition covers the entire field - from principles of analog and digital communications to cordless telephones, wireless local area networks (LANs), and international technology standards. The amazing scope of the handbook ensures that it will be the primary reference for every aspect of mobile communications.

Handbook of Lubrication and Tribology, Volume II

Theory and Design, Second Edition

Author: Robert W. Bruce

Publisher: CRC Press

ISBN: 1420069098

Category: Technology & Engineering

Page: 1169

View: 6238

Since the publication of the best-selling first edition, the growing price and environmental cost of energy have increased the significance of tribology. Handbook of Lubrication and Tribology, Volume II: Theory and Design, Second Edition demonstrates how the principles of tribology can address cost savings, energy conservation, and environmental protection. This second edition provides a thorough treatment of established knowledge and practices, along with detailed references for further study. Written by the foremost experts in the field, the book is divided into four sections. The first reviews the basic principles of tribology, wear mechanisms, and modes of lubrication. The second section covers the full range of lubricants/coolants, including mineral oil, synthetic fluids, and water-based fluids. In the third section, the contributors describe many wear- and friction-reducing materials and treatments, which are currently the fastest growing areas of tribology, with announcements of new coatings, better performance, and new vendors being made every month. The final section presents components, equipment, and designs commonly found in tribological systems. It also examines specific industrial areas and their processes. Sponsored by the Society of Tribologists and Lubrication Engineers, this handbook incorporates up-to-date, peer-reviewed information for tackling tribological problems and improving lubricants and tribological systems. The book shows how the proper use of generally accepted tribological practices can save money, conserve energy, and protect the environment.

Reference Data for Engineers

Radio, Electronics, Computer, and Communications

Author: Wendy Middleton,Mac E. Van Valkenburg

Publisher: Newnes

ISBN: 9780750672917

Category: Technology & Engineering

Page: 1672

View: 1634

This standard handbook for engineers covers the fundamentals, theory and applications of radio, electronics, computers, and communications equipment. It provides information on essential, need-to-know topics without heavy emphasis on complicated mathematics. It is a "must-have" for every engineer who requires electrical, electronics, and communications data. Featured in this updated version is coverage on intellectual property and patents, probability and design, antennas, power electronics, rectifiers, power supplies, and properties of materials. Useful information on units, constants and conversion factors, active filter design, antennas, integrated circuits, surface acoustic wave design, and digital signal processing is also included. This work also offers new knowledge in the fields of satellite technology, space communication, microwave science, telecommunication, global positioning systems, frequency data, and radar.

Classical and Quantum Information Theory

An Introduction for the Telecom Scientist

Author: Emmanuel Desurvire

Publisher: Cambridge University Press

ISBN: 9781139476652

Category: Technology & Engineering

Page: N.A

View: 8136

Information theory lies at the heart of modern technology, underpinning all communications, networking, and data storage systems. This book sets out, for the first time, a complete overview of both classical and quantum information theory. Throughout, the reader is introduced to key results without becoming lost in mathematical details. Opening chapters present the basic concepts and various applications of Shannon's entropy, moving on to the core features of quantum information and quantum computing. Topics such as coding, compression, error-correction, cryptography and channel capacity are covered from classical and quantum viewpoints. Employing an informal yet scientifically accurate approach, Desurvire provides the reader with the knowledge to understand quantum gates and circuits. Highly illustrated, with numerous practical examples and end-of-chapter exercises, this text is ideal for graduate students and researchers in electrical engineering and computer science, and practitioners in the telecommunications industry. Further resources and instructor-only solutions are available at

Mobile Communications Handbook, Third Edition

Author: Jerry D. Gibson

Publisher: CRC Press

ISBN: 1439817243

Category: Technology & Engineering

Page: 813

View: 7687

With 26 entirely new and 5 extensively revised chapters out of the total of 39, the Mobile Communications Handbook, Third Edition presents an in-depth and up-to-date overview of the full range of wireless and mobile technologies that we rely on every day. This includes, but is not limited to, everything from digital cellular mobile radio and evolving personal communication systems to wireless data and wireless networks Illustrating the extraordinary evolution of wireless communications and networks in the last 15 years, this book is divided into five sections: Basic Principles provides the essential underpinnings for the wide-ranging mobile communication technologies currently in use throughout the world. Wireless Standards contains technical details of the standards we use every day, as well as insights into their development. Source Compression and Quality Assessment covers the compression techniques used to represent voice and video for transmission over mobile communications systems as well as how the delivered voice and video quality are assessed. Wireless Networks examines the wide range of current and developing wireless networks and wireless methodologies. Emerging Applications explores newly developed areas of vehicular communications and 60 GHz wireless communications. Written by experts from industry and academia, this book provides a succinct overview of each topic, quickly bringing the reader up to date, but with sufficient detail and references to enable deeper investigations. Providing much more than a "just the facts" presentation, contributors use their experience in the field to provide insights into how each topic has emerged and to point toward forthcoming developments in mobile communications.


Prinzipien, Techniken und Werkzeuge

Author: Alfred V. Aho

Publisher: Pearson Deutschland GmbH

ISBN: 9783827370976

Category: Compiler

Page: 1253

View: 2208