Questions tagged [stochastic-process]

For questions related to processes that change randomly over time. Examples include Markov processes, random walks, and renewal processes.

Filter by
Sorted by
Tagged with
0 votes
0 answers
46 views

monte carlo for a selection problem

What type of Monte Carlo simulation is suitable for solving this problem? Also, how can we select results after simulation to guarantee feasibility?
0 votes
0 answers
78 views

Resource allocation problem - RL or stochastic optimization?

I am currently working on a resource allocation problem and I am uncertain about which field of stochastic optimization and reinforcement learning encompasses this particular problem. The objective is ...
1 vote
0 answers
27 views

Understanding queueing theory used to model the vehicle routing problem

I am trying to understand some journal articles on the vehicle routing problem, specifically Vehicle routing with dynamic travel times: A queueing approach and An M/M/c queue model for vehicle routing ...
3 votes
0 answers
50 views

m/m/1/k=1 variance

Is there a nice formula for the finite time variance of the m/m/1/k=1 queue in steady state? (Exponential arrivals $\lambda$, exponential service time $\mu$, 1 server and no queue, so if a job arrives ...
5 votes
0 answers
79 views

Best method to optimize the blending of different types of coal to ensure all quality parameters are met at the lowest possible price?

I am looking to optimize the blending of different types of coal for the coke making process of a steel plant. I want to take into account the statistical variation of each coal’s qualities, so for ...
3 votes
1 answer
256 views

Optimization for Stochastic Simulations

This questions stems from my original question here. I have a system, where each 'run' is a simulation of agents switching between tasks (or states) as in a Markov Chain. I would like to find ways to ...
9 votes
6 answers
2k views

Are optimization results stochastic?

I'm asking myself for some time if the results of optimization are random. As search for stochastic and optimization gives results about stochastic optimization but does not help with the ...
2 votes
2 answers
64 views

How to verify the correctness of forecast?

I would like to forecast the car rental (count time series). Given hourly integer valued car rentals for a month's period from 24th september to 24th October. I need to forecast car rental demand ...
1 vote
1 answer
283 views

The impact of utilization rate of a queueing system on its average queue time

For an $M/M/c$ queue where arrivals follow a Poisson distribution with rate $\lambda$ and are iid, service follows a Poisson process with rate $\mu$ and there are $c$ parallel servers, we can estimate ...
3 votes
0 answers
29 views

How to establish the optimal value functions and optimal control policy for a controlled random walk problem?

Question: How to establish an explicit characterization of both the optimal value functions and the optimal control policy for a controlled random walk? Background: Assume our system is a perfectly-...
1 vote
0 answers
140 views

Simple inventory control with stochastic demand

There is a factory that produces one unit of stock uniformly so that $q$ units of stock are produced during a day. The warehouse near a factory has the maximal capacity of $q$ items, i.e. a daily ...
4 votes
0 answers
62 views

Mixing time exponent above threshold temperature for Glauber dynamics or annealing

It is well-known that the Glauber dynamics will converge in polynomial time to the Gibbs distribution for, say, the Ising model on a d-regular graph at high enough temperatures $T>T_c$. There are ...
5 votes
0 answers
27 views

What are some references for Fluid and Diffusion models in Queuing?

In queuing theory and stochastic process, there are many papers that have applied fluid and diffusion models to approximate the original models. However, the concepts and basics of these models are ...
5 votes
0 answers
54 views

What kind of algorithm is this: water foraging

I am pondering if a machine learning problem might be better formulated as a reinforcement or control problem. I have no experience with the latter, so bear with me. Let's say I am organising a tour ...
8 votes
2 answers
189 views

Does dispersion really matter?

Context: Given a counting process $\{N(t),\,t\ge 0\}$ which tracks the number of events (arrivals) by time $t$, the index of dispersion (for counts) is the variance-to-mean ratio of the cumulative ...
12 votes
1 answer
138 views

Model or State Uncertainty in Queueing Model due to uncertain arrival rate

Introduction I am currently modelling a scenario where two queues need to be served by a single server in a non preemptive discipline. I am quite sorted on generating the optimal policy via Value or ...
4 votes
1 answer
78 views

Optimize probability parameter in an optimal control problem

We have a game with infinite but countable rounds. We have one machine, that may either break down, or continue operating. For each round the machine operates, it gives cost $-1$ (so profit of $1$). ...
6 votes
0 answers
142 views

Can demand be modeled by a limited amount of probability distributions?

In stochastic inventory control, it is very important to model the demand appropriate to set e.g. order levels. Demand can be fit to a certain probability distribution via many means (e.g. a goodness ...
15 votes
5 answers
5k views

Good textbook for queueing theory and performance modeling

Can someone recommend a good self-study textbook for queueing theory and performance modeling? My interest is in applying this to understanding the behavior of some real-world server networks, ...
9 votes
1 answer
260 views

Stochastic VRP: Sources of uncertainty and modeling approaches

In one of the archived research topics of mine, I tried to model and solve SVRPs using Multiple Tandem Queues. I have two related questions: What are the sources for uncertainty in Stochastic VRPs? ...