Publications of Urtzi AYESTA
Francisco Robledo Relaño, Vivek Borkar, Urtzi Ayesta, Konstantin Avrachenkov
Tabular and Deep Learning for the Whittle Index
ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 2024, ⟨10.1145/3670686⟩
Fernando Miguelez, Urtzi Ayesta, Josu Doncel
Price of Anarchy with multiple information sources under competition
Operations Research Letters, 2023, 51 (6), pp.605-611. ⟨10.1016/j.orl.2023.10.004⟩
Santiago Guillermo Duran, Urtzi Ayesta, Ina Maria Maaike Verloop
On the Whittle index of Markov Modulated Restless Bandits
Queueing Systems, 2022, pp.1-55. ⟨10.1007/s11134-022-09737-y⟩
Reinforcement Learning in Queues
Queueing Systems, 2022, Special Issue, 100, pp.497-499. ⟨10.1007/s11134-022-09844-w⟩
Urtzi Ayesta, Tejas Bodas, Jan-Pieter Dorsman, Ina Maria Maaike Verloop
A token-based central queue with order-independent service rates
Operations Research, 2022, 70 (1), ⟨10.1287/opre.2020.2088⟩
Elene Anton, Urtzi Ayesta, Matthieu Jonckheere, Ina Maria Maaike Verloop
On the stability of redundancy models
Operations Research, 2021, 69 (5), pp.1540-1565. ⟨10.1287/opre.2020.2030⟩
Elene Anton, Urtzi Ayesta, Matthieu Jonckheere, Ina Maria Maaike Verloop
Improving the performance of heterogeneous data centers through redundancy
Proceedings of the ACM on Measurement and Analysis of Computing Systems , 2020, 4 (3), pp.1-29. ⟨10.1145/3428333⟩
Urtzi Ayesta, Manu K. Gupta, Ina Maria Maaike Verloop
On the computation of Whittle’s Index for Markovian restless bandits
Mathematical Methods of Operations Research, 2020, 93, pp.179-208. ⟨10.1007/s00186-020-00731-9⟩
Urtzi Ayesta, Balakrishna Prabhu, Rhonda Righter
Scheduling in a single-server with state-dependent service rates
Probability in the Engineering and Informational Sciences, 2020, 34 (4), pp.507 – 521. ⟨10.1017/S0269964819000160⟩
Christian Carballo, Urtzi Ayesta, Dieter Fiems
Performance analysis of space-time priority queues
Performance Evaluation, 2019, 133, pp.25-42. ⟨10.1016/j.peva.2019.04.003⟩
Urtzi Ayesta, Tejas Bodas, Ina Maria Maaike Verloop
On a unifying product form framework for redundancy models
Performance Evaluation, 2018, 127-128, pp.93-119. ⟨10.1016/j.peva.2018.09.008⟩
Urtzi Ayesta, Peter Jacko, Vladimir Novak
Scheduling of multi-class multi-server queueing systems with abandonments
Journal of Scheduling, 2017, 20 (2), pp.129–145. ⟨10.1007/s10951-015-0456-7⟩
Maialen Larranaga, Urtzi Ayesta, Ina Maria Maaike Verloop
Dynamic control of birth-and-death restless bandits: application to resource-allocation problems
IEEE/ACM Transactions on Networking, 2016, 24 (6), pp.3812–3825. ⟨10.1109/TNET.2016.2562564⟩
Ane Izagirre, Urtzi Ayesta, Ina Maria Maaike Verloop
Sojourn time approximations for a discriminatory-processor-sharing queue
ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 2016, 1 (1), pp.article n°5. ⟨10.1145/2812807⟩
Maialen Larrañaga, Urtzi Ayesta, Ina Maria Maaike Verloop
Asymptotically optimal index policies for an abandonment queue with convex holding cost.
Queueing Systems, 2015, 81 (2), pp.99-169. ⟨10.1007/s11134-015-9445-y⟩
Ane Izagirre, Urtzi Ayesta, Ina Maria Maaike Verloop
Interpolation approximations for the steady-state distribution in multi-class resource-sharing systems
Performance Evaluation, 2015, vol. 91, pp. 56-79. ⟨10.1016/j.peva.2015.06.005⟩
Ane Izagirre, Urtzi Ayesta, Ina Maria Maaike Verloop
Heavy-traffic analysis of a non-preemptive multi-class queue with relative priorities
Probability in the Engineering and Informational Sciences, 2015, 29 (2), pp.153-180
Maialen Larranaga, Urtzi Ayesta, Maaike Verloop
Dynamic fluid-based scheduling in a multi-class abandonment queue
In : Performance Evaluation, Elsevier, Special issue Proc. Performance 2013, Vol. 70, pp. 841-858, September 2013.
Urtzi Ayesta, Martin Erausquin, Matthieu Jonckheere, Maaike Verloop
Scheduling in a random environment: stability and asymptotic optimality
In : IEEE/ACM Transactions on Networking, IEEE : Institute of Electrical and Electronics Engineers, Vol. 21 N. 1, pp. 258-271, February 2013.
URL : http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=06209453 – https://oatao.univ-toulouse.fr/12319/
BibTeXUrtzi Ayesta, Onno Boxma, Maaike Verloop
Sojourn times in a processor sharing queue with multiple vacations
In : Queueing Systems, Springer, Vol. 71, pp. 53-78, June 2012.
URL : http://www.springerlink.com/content/t32tq77233nl5297/fulltext.pdf
BibTeXUrtzi Ayesta, Ane Izagirre, Maaike Verloop
Heavy-traffic analysis of the discriminatory random-order-of-service discipline
In : Performance Evaluation Review, ACM : Association for Computing Machinery, New York, États-Unis, Vol. 39 N. 2, pp. 41-43, 2011.
URL : http://dl.acm.org/citation.cfm?doid=2034832.2034842
BibTeX
Francisco Robledo, Urtzi Ayesta, Konstantin Avrachenkov
Deep reinforcement learning for weakly coupled MDP’s with continuous actions
ACM SIGMETRICS / ASMTA 2024, Jun 2024, Venise, Italy
Daniel Mastropietro, Szymon Majewski, Urtzi Ayesta, Matthieu Jonckheere
Boosting reinforcement learning with sparse and rare rewards using Fleming-Viot particle systems
15th European Workshop on Reinforcement Learning (EWRL 2022), Sep 2022, Milano, Italy
Francisco Robledo, Vivek S Borkar, Urtzi Ayesta, Konstantin Avrachenkov
Tabular and Deep Learning of Whittle Index
EWRL 2022 – 15th European Workshop of Reinforcement Learning, Sep 2022, Milan, Italy
Fernando Miguelez, Urtzi Ayesta, Josu Doncel
A Non-cooperative Game for the Freshness of Status Updates
23ème Congrès annuel de la Société Française de Recherche Opérationnelle et d’Aide à la Décision (ROADEF 2022), Société Française de Recherche Opérationnelle et d’Aide à la Décision; INSA Lyon – Université de Lyon, Feb 2022, Villeurbanne – Lyon, France
Francisco Robledo, Vivek Borkar, Urtzi Ayesta, Konstantin Avrachenkov
QWI: Q-learning with Whittle Index
RLNQ 2021 – Reinforcement Learning in Networks and Queues (workshop at ACM Sigmetrics 2021), Jun 2021, Beijing, China. pp.47-50, ⟨10.1145/3512798.3512816⟩
Thi Thuy Nga Nguyen, Urtzi Ayesta, Balakrishna Prabhu
Scheduling users in drive-thru Internet: a multi-armed bandit approach
WiOpt 2019, International Federation for Information Processing (IFIP), Jun 2019, Avignon, France. ⟨10.23919/WiOPT47501.2019.9144139⟩
Elene Anton, Urtzi Ayesta, Florian Simatos
On the impact of mobility in cellular networks
17th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WIOPT 2019), IFIP: International Federation for Information Processing, Jun 2019, Avignon, France. pp.1-8, ⟨10.23919/WiOPT47501.2019.9144135⟩
Josu Doncel, Samuli Aalto, Urtzi Ayesta
Economies of scale in parallel-server systems
IEEE Infocom, May 2017, Atlanta, United States. pp.1–9, ⟨10.1109/INFOCOM.2017.8057093⟩
Maialen Larranaga, Urtzi Ayesta, Ina Maria Maaike Verloop
Index Policies for multi-class queues with convex holding cost and abandonments
ACM International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS 2014), Jun 2014, Austin, Texas, United States. pp.125-137, ⟨10.1145/2591971.2591983⟩
Ane Izagirre, Urtzi Ayesta, Ina Maria Maaike Verloop
Sojourn time approximations in a multi-class time-sharing server
IEEE International conference on Comptuer Communications – INFOCOM 2014, Apr 2014, Toronto, Canada. pp. 2786-2794, ⟨10.1109/INFOCOM.2014.6848228⟩
Alexey Baraev, Urtzi Ayesta, Maaike Verloop, Daniele Miorandi, I Chlamtac
Technical vulnerability of the E-UTRA paging mechanism (regular paper)
In : IEEE Wireless Communications and Networking Conference (WCNC 2012), Paris, 01/04/12-04/04/12, IEEE : Institute of Electrical and Electronics Engineers, pp. 1-6, April 2012.
Elene Anton, Urtzi Ayesta, Matthieu Jonckheere, Ina Maria Maaike Verloop
A Survey of Stability Results for Redundancy Systems
Alexey Piunovskiy; Yi Zhang. Modern Trends in Controlled Stochastic Processes : Theory and Applications, Volume III, 41, Springer, pp.266-283, 2021, Emergence, Complexity and Computation (ECC), 978-3-030-76927-7. ⟨10.1007/978-3-030-76928-4_13⟩
Urtzi Ayesta, Balakrishna Prabhu
Special volume on selected papers from the second ECQT conference (ECQT 2016), Toulouse, France
Ayesta, Urtzi; Prabhu, Balakrishna. , 119, 53 p., 2018, Performance Evaluation, ISSN: 0166-5316. ⟨10.1016/j.peva.2017.12.001⟩
Urtzi Ayesta, Marko Boon, Balakrishna Prabhu, Rhonda Righter, Ina Maria Maaike Verloop
EUROPEAN CONFERENCE ON QUEUEING THEORY 2016
Urtzi Ayesta, Balakrishna Prabhu, Ina Maria Maaike Verloop
Actes du 11ème Atelier en Évaluation de Performances
Urtzi AYESTA; Balakrishna J. PRABHU; Ina Maria VERLOOP. 11ème Atelier en Évaluation de Performances (2016), Mar 2016, Toulouse, France. , 2016
Daniel Mastropietro, Urtzi Ayesta, Matthieu Jonckheere, Szymon Majewski
Efficient reinforcement learning with Fleming-Viot particle systems: application to stochastic networks with rarely observed rewards
2023