Installation

Install Agentary JS via npm:

npm install agentary-js

Requirements

For Device Provider (On-Device Inference)

• Node.js 18 or higher
• Modern browser with WebGPU or WebAssembly support

Browser Support

WebGPU Support

WebAssembly Support

WebAssembly is used as a fallback when WebGPU is not available, providing broad compatibility across devices.

Minimum Hardware

• RAM: 4GB recommended for small models (270M-500M parameters)
• GPU: Optional but recommended for WebGPU acceleration
• Storage: Varies by model (typically 100MB-500MB per quantized model)

For Cloud Provider (Cloud Inference)

• A backend server to proxy API requests
• API keys from cloud providers:
  • Anthropic API Key for Claude models
  • OpenAI API Key for GPT models

Cloud Provider Setup:

1. Set up a proxy server (see Cloud Provider Guide)
2. Store API keys securely on your backend
3. Configure Agentary JS to use your proxy endpoint

# Example: Install proxy dependencies
npm install express @anthropic-ai/sdk
# or
npm install express openai

Verifying Installation

Test Device Provider

Create a simple test file to verify device provider installation:

import { createSession, isSupportedModel, getSupportedModelIds } from 'agentary-js';
 
console.log('Agentary JS installed successfully!');
console.log('Supported models:', getSupportedModelIds());
console.log('Qwen3 supported:', isSupportedModel('onnx-community/Qwen3-0.6B-ONNX'));

Test Cloud Provider

Verify cloud provider connectivity:

import { createSession } from 'agentary-js';
 
const session = await createSession({
  models: [{
    runtime: 'anthropic',
    model: 'claude-3-5-sonnet-20241022',
    proxyUrl: 'http://localhost:3001/api/anthropic',
    modelProvider: 'anthropic'
  }]
});
 
console.log('Cloud provider configured successfully!');
await session.dispose();

Next Steps

Now that you have Agentary JS installed:

1. Choose between on-device or cloud inference
2. Set up a Cloud Provider (if using cloud models)
3. Review Core Concepts to understand the architecture
4. Build your first application with the Quick Start guide