Skip to main content
Ctrl+K

Xoscar documentation

  • Getting Started
  • User Guide
  • API Reference
  • GitHub
  • Getting Started
  • User Guide
  • API Reference
  • GitHub

Section Navigation

  • Installation
  • Quickstart
  • Use case: LLM inference on heterogeneous hardware
  • Getting Started

Getting Started#

  • Installation
    • Python version support
    • Dependencies
  • Quickstart
    • Create actor pools
    • Define an actor
    • Create actors
    • Compute Pi
  • Use case: LLM inference on heterogeneous hardware
    • Setup
    • Define actors
    • Create actor pools
    • Create actors
    • Inference
    • Conclusion

previous

Xoscar: Python actor framework for heterogeneous computing

next

Installation

This Page

  • Show Source

© Copyright 2023, Xorbits Inc..

Created using Sphinx 7.4.7.

Built with the PyData Sphinx Theme 0.16.1.