Skip to content

autonomous-AI-lab/2xGPUs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Typing SVG

License: MIT GitHub stars Status Downloads Version Repo Size Open Issues Open Pull Requests

This guide shows you how to build a cutting-edge AI server with 2x GPUs. From hardware selection to software setup, follow each step to create a high-performance platform for deep learning, data science, and GPU-intensive workloads.

📚 Table of Contents

  • 🏁 Introduction
  • 🛠️ Preparation
  • 🤖 Assembly
  • ⚙️ Setup
  • 🧪 Testing
  • 📦 BOM
  • 📝 License

🏁 Introduction   🔝

This tutorial guides you through building a high-performance AI server equipped with two GPUs. Whether you're a researcher, developer, or enthusiast, you'll learn everything from selecting and assembling the right hardware to configuring your system and performing initial tests. By the end, you'll have a powerful platform ready for demanding AI workloads.

🛠️ Preparation   🔝


🤖 Assembly   🔝

See detailed steps


⚙️ Setup   🔝

BIOS Optimization for GPU Performance

Tip: The default BIOS settings may not deliver optimal performance for multi-GPU workloads. Adjust these parameters for best results:

  • Above 4G Decoding Static Badge
    🚨📢🔔⚠️ Enable "Above 4G Decoding" to address large GPU memory.

    Advanced -> PCI Subsystems Settings -> Enable Above 4G Decoding
    
  • Resizable BAR Static Badge
    🚨📢🔔⚠️ Activate "Resizable BAR" for improved CPU-GPU data transfer.

    Advanced -> PCI Subsystems Settings -> Enable Re-size BAR support
    
  • Power Management
    Disable unnecessary power-saving features (C-states, ASPM) that may throttle GPU performance.
    Optional

  • Memory Configuration
    Set RAM to rated speed and enable XMP/DOCP profiles for max bandwidth.
    Optional

  • Fan and Thermal Controls
    Adjust fan curves and thermal limits for optimal cooling.
    Optional

After saving changes, reboot and monitor GPU performance and stability.

References:


🧪 Testing   🔝

Boot with WinPE from USB to verify hardware, or install Linux, NVIDIA drivers, and check with nvidia-smi or nvtop. Once confirmed, install your OS and start your AI work.



📦 Bill of Materials (BOM)   🔝


📝 License   🔝

This project is open source under the MIT License.


Typing SVG

About

A hands-on guide for AI builders: make your own RTX 4090D/5090 GPU server that’s fast and efficient.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published