RL4Ising

Overview

• Introduction
  • Welcome to RL4Ising!
• Key Concepts
  • Ising Models
  • Boltzmann Distribution
  • Deep Reinforcement Learning
• Content
  • Datasets
  • Baseline Solvers
  • Benchmark

Datasets

• Datasets
  • Classification of Ising Models
  • Spin Glass Ising Model
  • Spin Ice Ising Model
  • Ferromagnetic Ising Model
  • Anti-Ferromagnetic Ising Model
• Dataset 1
  • Spin Glass Dataset
  • Description of Ising Model Type
  • Instances
  • Dataset References
• Ferromagnetic Dataset
  • Description of Ising Model Type
  • Instances
  • Dataset References
• Anti-Ferromagnetic Dataset
  • Description of Ising Model Type
  • Instances
  • Dataset References
• Spin-Ice Dataset
  • Description
  • Instances
  • Dataset References
• Dataset 2

Baseline Solvers

• Gurobi Solver
  • Overview
  • Strengths
  • Weaknesses
  • Mosek Solver
  • COPT Solver
  • Ecole Solver
  • SCIP Solver
  • RL4CO Solver
• IBM ILOG CPLEX Solver
• COPT Solver
• SCIP Solver

Reinforcement Learning Algorithms

• S2V-DQN Algorithm
  • Overview
• Variational Neural Annealing (VCA)
  • Overview
  • Strengths
  • Weaknesses
• Monte Carlo Policy Gradient with Local Search (MCPG)
  • Overview
  • Strengths
  • Weaknesses
• REINFORCE Algorithm
  • Overview

Benchmark

• Benchmark Results
  • Solver Benchmarks
  • RL Benchmarks
  • Physics Benchmarks

RL4Ising Competition 2025

• Overview
  • Tasks
• Task 1: RL4MaxCut
  • Task Overview
  • Datasets
  • Starter Kit
  • Commands
  • Benchmark
• Task 2: RL4Ising
  • Task Overview
  • Datasets
  • Starter Kit
  • Benchmark
  • Metrics

References

• Dataset References

Levy Lin, Zhiyuan Wang, Holden Mac Entee, Xingjian Zhao, and Xiao-Yang Liu. Reinforcement Learning for Ising Models: Datasets and Benchmark. NeurIPS 2025 Workshop on Machine Learning for the Physical Sciences (ML4PS).