Auto.gov: Learning-based Governance for Decentralized Finance (DeFi)

—

Auto.gov: Learning-based Governance for Decentralized Finance (DeFi)

Jiahua Xu
Yebo Feng
Daniel Perez
Benjamin Livshits
Published on 2/19/2023
Crypto
Derivatives
AI
Reinforcement learning
Risk management
Machine learning

Auto.gov introduces a learning-based governance framework for decentralized finance (DeFi) protocols, specifically targeting the automated adjustment of risk parameters such as collateral factors in lending protocols like Aave. The framework employs a Deep Q-Network (DQN) reinforcement learning agent that interacts with a stylized DeFi environment modeled as a Markov Decision Process. The environment simulates user actions (deposit, withdraw, borrow, repay, liquidate) and market dynamics, including price oracle attacks. The agent's objective is to maximize the protocol's net position (profitability) by adjusting collateral factors incrementally, with constraints to ensure safety and controllability.

Experimental results demonstrate that Auto.gov significantly outperforms both static baselines and benchmark approaches. In simulated scenarios with price oracle attacks, the RL agent improves protocol profitability by over 60% compared to a baseline agent. In real-world data tests, Auto.gov achieves at least a 14% improvement over the best benchmark and a tenfold improvement over the static baseline. The training process is efficient, converging in about 4 hours on a laptop, which is orders of magnitude faster than traditional week-long governance votes. The framework also enhances security by mitigating risks from market manipulations and human biases, contributing to the sustainability of DeFi protocols. This work represents the first known integration of AI with DeFi governance, offering a scalable and resilient alternative to manual or voting-based parameter adjustments.

Highlights

  • 1First integration of AI with DeFi governance for automated parameter adjustment.
  • 2Formalization of an Aave-like DeFi environment as a Markov Decision Process for RL training.
  • 3Demonstrates over 60% profit improvement in simulated oracle attack scenarios and 14% over benchmarks in real-world tests.
  • 4Training completes in ~4 hours on a laptop, vastly outperforming week-long manual governance processes.
  • 5Enhances protocol security, profitability, and sustainability through data-driven, attack-resilient governance.

Methods

  • M
    Deep Q-Network (DQN) reinforcement learning for governance agent training.
  • M
    Markov Decision Process (MDP) modeling of the DeFi lending environment.
  • M
    Simulation of user behavior and market dynamics including price oracle attacks.
  • M
    Baseline comparison with static and benchmark governance approaches.

Results

  • R
    Auto.gov boosts protocol profit by over 60% compared to baseline in simulated oracle attack scenarios.
  • R
    In real-world testing, Auto.gov outperforms the best benchmark by 14% and static baseline tenfold.
  • R
    Training converges in approximately 4 hours on a standard laptop, enabling rapid adaptation.
  • R
    The agent effectively retains funds that would otherwise be lost to price oracle attacks.
  • R
    Gradual action constraints prevent erratic system behavior and mitigate black-swan risks.
0/5

Analyze Paper

Generate insights from "Auto.gov: Learning-based Governance for Decentralized Financ...".

Suggested Actions