Hidden Semi-Markov Models

Theory, Algorithms and Applications

Author: Shun-Zheng Yu

Publisher: Morgan Kaufmann

ISBN: 0128027711

Category: Computers

Page: 208

View: 887

Hidden semi-Markov models (HSMMs) are among the most important models in the area of artificial intelligence / machine learning. Since the first HSMM was introduced in 1980 for machine recognition of speech, three other HSMMs have been proposed, with various definitions of duration and observation distributions. Those models have different expressions, algorithms, computational complexities, and applicable areas, without explicitly interchangeable forms. Hidden Semi-Markov Models: Theory, Algorithms and Applications provides a unified and foundational approach to HSMMs, including various HSMMs (such as the explicit duration, variable transition, and residential time of HSMMs), inference and estimation algorithms, implementation methods and application instances. Learn new developments and state-of-the-art emerging topics as they relate to HSMMs, presented with examples drawn from medicine, engineering and computer science. Discusses the latest developments and emerging topics in the field of HSMMs Includes a description of applications in various areas including, Human Activity Recognition, Handwriting Recognition, Network Traffic Characterization and Anomaly Detection, and Functional MRI Brain Mapping. Shows how to master the basic techniques needed for using HSMMs and how to apply them.

Semi-Markov Chains and Hidden Semi-Markov Models toward Applications

Their Use in Reliability and DNA Analysis

Author: Vlad Stefan Barbu,Nikolaos Limnios

Publisher: Springer Science & Business Media

ISBN: 0387731733

Category: Mathematics

Page: 226

View: 5064

Here is a work that adds much to the sum of our knowledge in a key area of science today. It is concerned with the estimation of discrete-time semi-Markov and hidden semi-Markov processes. A unique feature of the book is the use of discrete time, especially useful in some specific applications where the time scale is intrinsically discrete. The models presented in the book are specifically adapted to reliability studies and DNA analysis. The book is mainly intended for applied probabilists and statisticians interested in semi-Markov chains theory, reliability and DNA analysis, and for theoretical oriented reliability and bioinformatics engineers.

Hidden Markov Models for Time Series

An Introduction Using R, Second Edition

Author: Walter Zucchini,Iain L. MacDonald,Roland Langrock

Publisher: CRC Press

ISBN: 1482253844

Category: Mathematics

Page: 370

View: 8278

Hidden Markov Models for Time Series: An Introduction Using R, Second Edition illustrates the great flexibility of hidden Markov models (HMMs) as general-purpose models for time series data. The book provides a broad understanding of the models and their uses. After presenting the basic model formulation, the book covers estimation, forecasting, decoding, prediction, model selection, and Bayesian inference for HMMs. Through examples and applications, the authors describe how to extend and generalize the basic model so that it can be applied in a rich variety of situations. The book demonstrates how HMMs can be applied to a wide range of types of time series: continuous-valued, circular, multivariate, binary, bounded and unbounded counts, and categorical observations. It also discusses how to employ the freely available computing environment R to carry out the computations. Features Presents an accessible overview of HMMs Explores a variety of applications in ecology, finance, epidemiology, climatology, and sociology Includes numerous theoretical and programming exercises Provides most of the analysed data sets online New to the second edition A total of five chapters on extensions, including HMMs for longitudinal data, hidden semi-Markov models and models with continuous-valued state process New case studies on animal movement, rainfall occurrence and capture–recapture data

Semi-Markov Models

Theory and Applications

Author: Jacques Janssen

Publisher: Springer Science & Business Media

ISBN: 148990574X

Category: Mathematics

Page: 588

View: 9567

This book is the result of the International Symposium on Semi Markov Processes and their Applications held on June 4-7, 1984 at the Universite Libre de Bruxelles with the help of the FNRS (Fonds National de la Recherche Scientifique, Belgium), the Ministere de l'Education Nationale (Belgium) and the Bernoulli Society for Mathe matical Statistics and Probability. This international meeting was planned to make a state of the art for the area of semi-Markov theory and its applications, to bring together researchers in this field and to create a platform for open and thorough discussion. Main themes of the Symposium are the first ten sections of this book. The last section presented here gives an exhaustive biblio graphy on semi-Markov processes for the last ten years. Papers selected for this book are all invited papers and in addition some contributed papers retained after strong refereeing. Sections are I. Markov additive processes and regenerative systems II. Semi-Markov decision processes III. Algorithmic and computer-oriented approach IV. Semi-Markov models in economy and insurance V. Semi-Markov processes and reliability theory VI. Simulation and statistics for semi-Markov processes VII. Semi-Markov processes and queueing theory VIII. Branching IX. Applications in medicine X. Applications in other fields v PREFACE XI. A second bibliography on semi-Markov processes It is interesting to quote that sections IV to X represent a good sample of the main applications of semi-Markov processes i. e.

Semi-Markov Models and Applications

Author: Jacques Janssen,Nikolaos Limnios

Publisher: Springer Science & Business Media

ISBN: 1461332885

Category: Mathematics

Page: 404

View: 1754

This book presents a selection of papers presented to the Second Inter national Symposium on Semi-Markov Models: Theory and Applications held in Compiegne (France) in December 1998. This international meeting had the same aim as the first one held in Brussels in 1984 : to make, fourteen years later, the state of the art in the field of semi-Markov processes and their applications, bring together researchers in this field and also to stimulate fruitful discussions. The set of the subjects of the papers presented in Compiegne has a lot of similarities with the preceding Symposium; this shows that the main fields of semi-Markov processes are now well established particularly for basic applications in Reliability and Maintenance, Biomedicine, Queue ing, Control processes and production. A growing field is the one of insurance and finance but this is not really a surprising fact as the problem of pricing derivative products represents now a crucial problem in economics and finance. For example, stochastic models can be applied to financial and insur ance models as we have to evaluate the uncertainty of the future market behavior in order, firstly, to propose different measures for important risks such as the interest risk, the risk of default or the risk of catas trophe and secondly, to describe how to act in order to optimize the situation in time. Recently, the concept of VaR (Value at Risk) was "discovered" in portfolio theory enlarging so the fundamental model of Markowitz.

Inference in Hidden Markov Models

Author: Olivier Cappé,Eric Moulines,Tobias Ryden

Publisher: Springer Science & Business Media

ISBN: 0387289828

Category: Mathematics

Page: 653

View: 8447

This book is a comprehensive treatment of inference for hidden Markov models, including both algorithms and statistical theory. Topics range from filtering and smoothing of the hidden Markov chain to parameter estimation, Bayesian methods and estimation of the number of states. In a unified way the book covers both models with finite state spaces and models with continuous state spaces (also called state-space models) requiring approximate simulation-based algorithms that are also described in detail. Many examples illustrate the algorithms and theory. This book builds on recent developments to present a self-contained view.

Mathematics of Financial Markets

Author: Robert J Elliott,P. Ekkehard Kopp

Publisher: Springer Science & Business Media

ISBN: 1475771460

Category: Mathematics

Page: 292

View: 3114

This book explores the mathematics that underpins pricing models for derivative securities such as options, futures and swaps in modern markets. Models built upon the famous Black-Scholes theory require sophisticated mathematical tools drawn from modern stochastic calculus. However, many of the underlying ideas can be explained more simply within a discrete-time framework. This is developed extensively in this substantially revised second edition to motivate the technically more demanding continuous-time theory.

Matrix-Analytic Methods in Stochastic Models

Author: Guy Latouche,Vaidyanathan Ramaswami,Jay Sethuraman,Karl Sigman,Mark S. Squillante,David Yao

Publisher: Springer Science & Business Media

ISBN: 146144909X

Category: Mathematics

Page: 258

View: 5233

Matrix-analytic and related methods have become recognized as an important and fundamental approach for the mathematical analysis of general classes of complex stochastic models. Research in the area of matrix-analytic and related methods seeks to discover underlying probabilistic structures intrinsic in such stochastic models, develop numerical algorithms for computing functionals (e.g., performance measures) of the underlying stochastic processes, and apply these probabilistic structures and/or computational algorithms within a wide variety of fields. This volume presents recent research results on: the theory, algorithms and methodologies concerning matrix-analytic and related methods in stochastic models; and the application of matrix-analytic and related methods in various fields, which includes but is not limited to computer science and engineering, communication networks and telephony, electrical and industrial engineering, operations research, management science, financial and risk analysis, and bio-statistics. These research studies provide deep insights and understanding of the stochastic models of interest from a mathematics and/or applications perspective, as well as identify directions for future research.

Markov Processes for Stochastic Modeling

Author: Oliver Ibe

Publisher: Newnes

ISBN: 0124078397

Category: Mathematics

Page: 514

View: 3043

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader. Presents both the theory and applications of the different aspects of Markov processes Includes numerous solved examples as well as detailed diagrams that make it easier to understand the principle being presented Discusses different applications of hidden Markov models, such as DNA sequence analysis and speech analysis.

Semi-Markov Processes and Reliability

Author: N. Limnios,G. Oprisan

Publisher: Springer Science & Business Media

ISBN: 1461201616

Category: Technology & Engineering

Page: 222

View: 5680

At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian mo tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia bility.

Hidden Markov Models

Estimation and Control

Author: Robert J Elliott,Lakhdar Aggoun,John B. Moore

Publisher: Springer Science & Business Media

ISBN: 0387848541

Category: Science

Page: 382

View: 6188

As more applications are found, interest in Hidden Markov Models continues to grow. Following comments and feedback from colleagues, students and other working with Hidden Markov Models the corrected 3rd printing of this volume contains clarifications, improvements and some new material, including results on smoothing for linear Gaussian dynamics. In Chapter 2 the derivation of the basic filters related to the Markov chain are each presented explicitly, rather than as special cases of one general filter. Furthermore, equations for smoothed estimates are given. The dynamics for the Kalman filter are derived as special cases of the authors’ general results and new expressions for a Kalman smoother are given. The Chapters on the control of Hidden Markov Chains are expanded and clarified. The revised Chapter 4 includes state estimation for discrete time Markov processes and Chapter 12 has a new section on robust control.

Bayesian Core: A Practical Approach to Computational Bayesian Statistics

Author: Jean-Michel Marin,Christian Robert

Publisher: Springer Science & Business Media

ISBN: 0387389830

Category: Mathematics

Page: 258

View: 2028

This Bayesian modeling book is intended for practitioners and applied statisticians looking for a self-contained entry to computational Bayesian statistics. Focusing on standard statistical models and backed up by discussed real datasets available from the book website, it provides an operational methodology for conducting Bayesian inference, rather than focusing on its theoretical justifications. Special attention is paid to the derivation of prior distributions in each case and specific reference solutions are given for each of the models. Similarly, computational details are worked out to lead the reader towards an effective programming of the methods given in the book.

Advances in Natural Computation

Pt. 2: First International Conference, ICNC 2005, Changsha, China, August 27-29, 2005, Proceedings

Author: Lipo Wang,Ke Chen,Yew Soon Ong

Publisher: Springer Science & Business Media

ISBN: 3540283250

Category: Computers

Page: 1292

View: 4977

The three volume set LNCS 3610, LNCS 3611, and LNCS 3612 constitutes the refereed proceedings of the First International Conference on Natural Computation, ICNC 2005, held in Changsha, China, in August 2005 jointly with the Second International Conference on Fuzzy Systems and Knowledge Discovery FSKD 2005 (LNAI volumes 3613 and 3614).The program committee selected 313 carefully revised full papers and 189 short papers for presentation in three volumes from 1887 submissions. The first volume includes all the contributions related to learning algorithms and architectures in neural networks, neurodynamics, statistical neural network models and support vector machines, and other topics in neural network models; cognitive science, neuroscience informatics, bioinformatics, and bio-medical engineering, and neural network applications as communications and computer networks, expert system and informatics, and financial engineering. The second volume concentrates on neural network applications such as pattern recognition and diagnostics, robotics and intelligent control, signal processing and multi-media, and other neural network applications; evolutionary learning, artificial immune systems, evolutionary theory, membrane, molecular, DNA computing, and ant colony systems. The third volume deals with evolutionary methodology, quantum computing, swarm intelligence and intelligent agents; natural computation applications as bioinformatics and bio-medical engineering, robotics and intelligent control, and other applications of natural computation; hardware implementations of natural computation, and fuzzy neural systems as well as soft computing.

Readings in Speech Recognition

Author: Alexander Waibel,Kai-Fu Lee

Publisher: Elsevier

ISBN: 0080515843

Category: Computers

Page: 680

View: 2663

After more than two decades of research activity, speech recognition has begun to live up to its promise as a practical technology and interest in the field is growing dramatically. Readings in Speech Recognition provides a collection of seminal papers that have influenced or redirected the field and that illustrate the central insights that have emerged over the years. The editors provide an introduction to the field, its concerns and research problems. Subsequent chapters are devoted to the main schools of thought and design philosophies that have motivated different approaches to speech recognition system design. Each chapter includes an introduction to the papers that highlights the major insights or needs that have motivated an approach to a problem and describes the commonalities and differences of that approach to others in the book.

Markov Processes and Applications

Algorithms, Networks, Genome and Finance

Author: Etienne Pardoux

Publisher: John Wiley & Sons

ISBN: 0470721863

Category: Mathematics

Page: 322

View: 6880

"This well-written book provides a clear and accessible treatment of the theory of discrete and continuous-time Markov chains, with an emphasis towards applications. The mathematical treatment is precise and rigorous without superfluous details, and the results are immediately illustrated in illuminating examples. This book will be extremely useful to anybody teaching a course on Markov processes." Jean-François Le Gall, Professor at Université de Paris-Orsay, France. Markov processes is the class of stochastic processes whose past and future are conditionally independent, given their present state. They constitute important models in many applied fields. After an introduction to the Monte Carlo method, this book describes discrete time Markov chains, the Poisson process and continuous time Markov chains. It also presents numerous applications including Markov Chain Monte Carlo, Simulated Annealing, Hidden Markov Models, Annotation and Alignment of Genomic sequences, Control and Filtering, Phylogenetic tree reconstruction and Queuing networks. The last chapter is an introduction to stochastic calculus and mathematical finance. Features include: The Monte Carlo method, discrete time Markov chains, the Poisson process and continuous time jump Markov processes. An introduction to diffusion processes, mathematical finance and stochastic calculus. Applications of Markov processes to various fields, ranging from mathematical biology, to financial engineering and computer science. Numerous exercises and problems with solutions to most of them

Hidden Markov Processes

Theory and Applications to Biology

Author: M. Vidyasagar

Publisher: Princeton University Press

ISBN: 1400850517

Category: Mathematics

Page: 312

View: 8227

This book explores important aspects of Markov and hidden Markov processes and the applications of these ideas to various problems in computational biology. The book starts from first principles, so that no previous knowledge of probability is necessary. However, the work is rigorous and mathematical, making it useful to engineers and mathematicians, even those not interested in biological applications. A range of exercises is provided, including drills to familiarize the reader with concepts and more advanced problems that require deep thinking about the theory. Biological applications are taken from post-genomic biology, especially genomics and proteomics. The topics examined include standard material such as the Perron-Frobenius theorem, transient and recurrent states, hitting probabilities and hitting times, maximum likelihood estimation, the Viterbi algorithm, and the Baum-Welch algorithm. The book contains discussions of extremely useful topics not usually seen at the basic level, such as ergodicity of Markov processes, Markov Chain Monte Carlo (MCMC), information theory, and large deviation theory for both i.i.d and Markov processes. The book also presents state-of-the-art realization theory for hidden Markov models. Among biological applications, it offers an in-depth look at the BLAST (Basic Local Alignment Search Technique) algorithm, including a comprehensive explanation of the underlying theory. Other applications such as profile hidden Markov models are also explored.