1. Introduction Markov chains have been used in a many different areas, this include but not limited to production, linguistics, finance, marketing, computer science, and signal processing. Andrei Andreyevich Markov (1856-1922) used this application in modelling the progress of consonants and vowels in the writings of Pushkin and Alzsakov [1]. In probability theory and the fields related to it, a Markov process, which was invented by the Russian mathematician Andrey Markov, is a stochastic process that satisfies the Markov property [2] in other worlds, a process can be described as the Markov chain if the future of the process can be predicted based only just on its present state, also the process's full history could be known, …show more content…
[6] gambler’s ruin and Random walks on integers are some instants of Markov processes. [7] Some variations of these processes were studied earlier in the form of independent variables. [7] There are two very important examples of Markov processes: Poisson process and Wiener process, the last is known as the Brownian motion process. [8] These two examples are the most important in the theory of stochastic processes, [9] and were discovered both before and after 1906. [10] The latest two processes are examples of continuous time Markov processes, while random walks on the integers and the gambler's ruin problem are examples of discrete time Markov processes. [11] There are many applications of Markov chains as statistical models of real-world processes, [12] such as The increase number of certain animal species, elaborating cruise control systems in motor vehicles, queues of customers arriving at a bank, exchange rates of currencies and storage systems such as dams. [13] The software used for Google search engine known as PageRank is based on a Markov process. [14] Markovian is the adjective that can be used to describe any process that has a relation to Markov …show more content…
Game of Hearts (Li5a) Hearts (li5a) is game for four players. Black Lady is one of the game names however, in Arabic it is called “Li5a”. The game is an evasion-type game; players try to not eat some penalty cards in tricks. At the end of the game the main target is to be the player with the least points.
Passing cards At the beginning of each round, each player chooses three cards, and passes them to another player. The targets of passing are to try to become "short" or "void" in a certain kind of cards, and thus can get rid of critical cards like the Spade Queen or the King or Ace also can get rid of high Hearts cards.
Like that the player will not be forced to win points in the game because he don’t have any further high dangerous cards.
Scoring
The scoring is calculating each round. Each Heart taken in a trick scores one penalty point against the player winning the trick, and taking Q♠ costs 13 penalty points. 10♦ is also a penalty card and will cost additional 10 points. There are thus 36 penalty points in each deal. The game reaches its end when one player exceeds 100