Numerical Methods for Structured Markov Chains


Author: Dario A. Bini,Guy Latouche,Beatrice Meini

Publisher: Oxford University Press on Demand

ISBN: 0198527683

Category: Computers

Page: 327

View: 4057

Intersecting two large research areas - numerical analysis and applied probability/queuing theory - this book is a self-contained introduction to the numerical solution of structured Markov chains, which have a wide applicability in queuing theory and stochastic modeling and include M/G/1 and GI/M/1-type Markov chain, quasi-birth-death processes, non-skip free queues and tree-like stochastic processes. Written for applied probabilists and numerical analysts, but accessible toengineers and scientists working on telecommunications and evaluation of computer systems performances, it provides a systematic treatment of the theory and algorithms for important families of structured Markov chains and a thorough overview of the current literature.The book, consisting of nine Chapters, is presented in three parts. Part 1 covers a basic description of the fundamental concepts related to Markov chains, a systematic treatment of the structure matrix tools, including finite Toeplitz matrices, displacement operators, FFT, and the infinite block Toeplitz matrices, their relationship with matrix power series and the fundamental problems of solving matrix equations and computing canonical factorizations. Part 2 deals with the description andanalysis of structure Markov chains and includes M/G/1, quasi-birth-death processes, non-skip-free queues and tree-like processes. Part 3 covers solution algorithms where new convergence and applicability results are proved. Each chapter ends with bibliographic notes for further reading, and the bookends with an appendix collecting the main general concepts and results used in the book, a list of the main annotations and algorithms used in the book, and an extensive index.

Exploiting Hidden Structure in Matrix Computations: Algorithms and Applications

Cetraro, Italy 2015


Author: Michele Benzi,Dario Bini,Daniel Kressner,Hans Munthe-Kaas,Charles Van Loan

Publisher: Springer

ISBN: 3319498878

Category: Mathematics

Page: 406

View: 3879

Focusing on special matrices and matrices which are in some sense `near’ to structured matrices, this volume covers a broad range of topics of current interest in numerical linear algebra. Exploitation of these less obvious structural properties can be of great importance in the design of efficient numerical methods, for example algorithms for matrices with low-rank block structure, matrices with decay, and structured tensor computations. Applications range from quantum chemistry to queuing theory. Structured matrices arise frequently in applications. Examples include banded and sparse matrices, Toeplitz-type matrices, and matrices with semi-separable or quasi-separable structure, as well as Hamiltonian and symplectic matrices. The associated literature is enormous, and many efficient algorithms have been developed for solving problems involving such matrices. The text arose from a C.I.M.E. course held in Cetraro (Italy) in June 2015 which aimed to present this fast growing field to young researchers, exploiting the expertise of five leading lecturers with different theoretical and application perspectives.

Markov Chains

Theory and Applications


Author: Bruno Sericola

Publisher: John Wiley & Sons

ISBN: 1118731530

Category: Mathematics

Page: 416

View: 2990

Markov chains are a fundamental class of stochastic processes.They are widely used to solve problems in a large number of domainssuch as operational research, computer science, communicationnetworks and manufacturing systems. The success of Markov chains ismainly due to their simplicity of use, the large number ofavailable theoretical results and the quality of algorithmsdeveloped for the numerical evaluation of many metrics ofinterest. The author presents the theory of both discrete-time andcontinuous-time homogeneous Markov chains. He carefully examinesthe explosion phenomenon, the Kolmogorov equations, the convergenceto equilibrium and the passage time distributions to a state and toa subset of states. These results are applied to birth-and-deathprocesses. He then proposes a detailed study of the uniformizationtechnique by means of Banach algebra. This technique is used forthe transient analysis of several queuing systems. Contents 1. Discrete-Time Markov Chains 2. Continuous-Time Markov Chains 3. Birth-and-Death Processes 4. Uniformization 5. Queues About the Authors Bruno Sericola is a Senior Research Scientist at Inria Rennes– Bretagne Atlantique in France. His main research activityis in performance evaluation of computer and communication systems,dependability analysis of fault-tolerant systems and stochasticmodels.

Large Truncated Toeplitz Matrices, Toeplitz Operators, and Related Topics

The Albrecht Böttcher Anniversary Volume


Author: Dario A. Bini,Torsten Ehrhardt,Alexei Yu. Karlovich,Ilya Spitkovsky

Publisher: Birkhäuser

ISBN: 3319491822

Category: Mathematics

Page: 740

View: 954

This book presents a collection of expository and research papers on various topics in matrix and operator theory, contributed by several experts on the occasion of Albrecht Böttcher’s 60th birthday. Albrecht Böttcher himself has made substantial contributions to the subject in the past. The book also includes a biographical essay, a complete bibliography of Albrecht Böttcher’s work and brief informal notes on personal encounters with him. The book is of interest to graduate and advanced undergraduate students majoring in mathematics, researchers in matrix and operator theory as well as engineers and applied mathematicians.

Engineering Mathematics II

Algebraic, Stochastic and Analysis Structures for Networks, Data Classification and Optimization


Author: Sergei Silvestrov,Milica Rančić

Publisher: Springer

ISBN: 3319421050

Category: Computers

Page: 436

View: 3604

This book highlights the latest advances in engineering mathematics with a main focus on the mathematical models, structures, concepts, problems and computational methods and algorithms most relevant for applications in modern technologies and engineering. It addresses mathematical methods of algebra, applied matrix analysis, operator analysis, probability theory and stochastic processes, geometry and computational methods in network analysis, data classification, ranking and optimisation. The individual chapters cover both theory and applications, and include a wealth of figures, schemes, algorithms, tables and results of data analysis and simulation. Presenting new methods and results, reviews of cutting-edge research, and open problems for future research, they equip readers to develop new mathematical methods and concepts of their own, and to further compare and analyse the methods and results discussed. The book consists of contributed chapters covering research developed as a result of a focused international seminar series on mathematics and applied mathematics and a series of three focused international research workshops on engineering mathematics organised by the Research Environment in Mathematics and Applied Mathematics at Mälardalen University from autumn 2014 to autumn 2015: the International Workshop on Engineering Mathematics for Electromagnetics and Health Technology; the International Workshop on Engineering Mathematics, Algebra, Analysis and Electromagnetics; and the 1st Swedish-Estonian International Workshop on Engineering Mathematics, Algebra, Analysis and Applications. It serves as a source of inspiration for a broad spectrum of researchers and research students in applied mathematics, as well as in the areas of applications of mathematics considered in the book.

Nonlinearly Perturbed Semi-Markov Processes


Author: Dmitrii Silvestrov,Sergei Silvestrov

Publisher: Springer

ISBN: 3319609882

Category: Mathematics

Page: 143

View: 9445

The book presents new methods of asymptotic analysis for nonlinearly perturbed semi-Markov processes with a finite phase space. These methods are based on special time-space screening procedures for sequential phase space reduction of semi-Markov processes combined with the systematical use of operational calculus for Laurent asymptotic expansions. Effective recurrent algorithms are composed for getting asymptotic expansions, without and with explicit upper bounds for remainders, for power moments of hitting times, stationary and conditional quasi-stationary distributions for nonlinearly perturbed semi-Markov processes. These results are illustrated by asymptotic expansions for birth-death-type semi-Markov processes, which play an important role in various applications. The book will be a useful contribution to the continuing intensive studies in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications that will contribute to continuing extensive studies in the area and remain relevant for years to come.

Quasi-stationary Phenomena in Nonlinearly Perturbed Stochastic Systems


Author: Mats Gyllenberg,Dmitriĭ Sergeevich Silʹvestrov

Publisher: De Gruyter


Category: Mathematics

Page: 579

View: 6261

This book is devoted to the mathematical studies of stochastic systems with quasi-stationary phenomena which have applications to population dynamics or epidemic models. In addition to its use for the research and reference purposes, the book can also be used in special courses on the subject and as a complementary reading in general courses on stochastic processes. In this respect, it may be useful for specialists as well as doctoral and advanced undergraduate students.

Introduction to the Numerical Solution of Markov Chains


Author: William J. Stewart

Publisher: Princeton University Press

ISBN: 0691036993

Category: Mathematics

Page: 539

View: 1140

Markov chains; Direct methods; Iterative methods; Projection methods; Block hessenberg matrices and solution by recursion; decompositional methods; P-cyclic markov chains; Trasient solutions; Stochastic automata networks; Software; Bibliography; Index.

Probability, Markov Chains, Queues, and Simulation

The Mathematical Basis of Performance Modeling


Author: William J. Stewart

Publisher: Princeton University Press

ISBN: 1400832810

Category: Mathematics

Page: 776

View: 9426

Probability, Markov Chains, Queues, and Simulation provides a modern and authoritative treatment of the mathematical processes that underlie performance modeling. The detailed explanations of mathematical derivations and numerous illustrative examples make this textbook readily accessible to graduate and advanced undergraduate students taking courses in which stochastic processes play a fundamental role. The textbook is relevant to a wide variety of fields, including computer science, engineering, operations research, statistics, and mathematics. The textbook looks at the fundamentals of probability theory, from the basic concepts of set-based probability, through probability distributions, to bounds, limit theorems, and the laws of large numbers. Discrete and continuous-time Markov chains are analyzed from a theoretical and computational point of view. Topics include the Chapman-Kolmogorov equations; irreducibility; the potential, fundamental, and reachability matrices; random walk problems; reversibility; renewal processes; and the numerical computation of stationary and transient distributions. The M/M/1 queue and its extensions to more general birth-death processes are analyzed in detail, as are queues with phase-type arrival and service processes. The M/G/1 and G/M/1 queues are solved using embedded Markov chains; the busy period, residual service time, and priority scheduling are treated. Open and closed queueing networks are analyzed. The final part of the book addresses the mathematical basis of simulation. Each chapter of the textbook concludes with an extensive set of exercises. An instructor's solution manual, in which all exercises are completely worked out, is also available (to professors only). Numerous examples illuminate the mathematical theories Carefully detailed explanations of mathematical derivations guarantee a valuable pedagogical approach Each chapter concludes with an extensive set of exercises