# Questions tagged [stochastic-process]

For questions related to processes that change randomly over time. Examples include Markov processes, random walks, and renewal processes.

8 questions
Filter by
Sorted by
Tagged with
38 views

### Mixing time exponent above threshold temperature for Glauber dynamics or annealing

It is well-known that the Glauber dynamics will converge in polynomial time to the Gibbs distribution for, say, the Ising model on a d-regular graph at high enough temperatures $T>T_c$. There are ...
33 views

### Best method to optimise the blending of different types of coal to ensure all quality parameters are met at the lowest possible price?

I am looking to optimise the blending of different types of coal for the coke making process of a steel plant. I want to take into account the statistical variation of each coal’s qualities, so for ...
55 views

### Optimize probability parameter in an optimal control problem

We have a game with infinite but countable rounds. We have one machine, that may either break down, or continue operating. For each round the machine operates, it gives cost $-1$ (so profit of $1$). ...
65 views

### Can demand be modeled by a limited amount of probability distributions?

In stochastic inventory control, it is very important to model the demand appropriate to set e.g. order levels. Demand can be fit to a certain probability distribution via many means (e.g. a goodness ...
79 views

### Model or State Uncertainty in Queueing Model due to uncertain arrival rate

Introduction I am currently modelling a scenario where two queues need to be served by a single server in a non preemptive discipline. I am quite sorted on generating the optimal policy via Value or ...
837 views

### Good textbook for queueing theory and performance modeling

Can someone recommend a good self-study textbook for queueing theory and performance modeling? My interest is in applying this to understanding the behavior of some real-world server networks, ...
Context: Given a counting process $\{N(t),\,t\ge 0\}$ which tracks the number of events (arrivals) by time $t$, the index of dispersion (for counts) is the variance-to-mean ratio of the cumulative ...