GitHub - Flyworks-AI/flyworks-mcp: Fast and free zeroshot lipsync MCP server (original) (raw)

Flyworks MCP: Free & Fast Zeroshot Lipsync Tool

Discord Flyworks AI Smithery Badge

Overview

The Flyworks MCP is a Model Context Protocol (MCP) server that provides a convenient interface for interacting with the Flyworks API. It facilitates fast and free lipsync video creation for a wide range of digital avatars, including realistic and cartoon styles.

Demo

Input avatar video (footage):

avatar.mp4

Audio clip with TTS saying 我是一个飞影数字人。Welcome to Flyworks MCP server demo. This tool enables fast and free lipsync video creation for a wide range of digital avatars, including realistic and cartoon styles.:

audio.mp4

Generated lipsync video:

generated.2.mp4

Features

Requirements

Usage

Integration with Claude or Other MCP Clients

Using in Claude Desktop

Go to Claude > Settings > Developer > Edit Config > claude_desktop_config.json to include the following:

{ "mcpServers": { "flyworks": { "command": "uvx", "args": [ "flyworks-mcp", "-y" ], "env": { "FLYWORKS_API_TOKEN": "your_api_token_here", "FLYWORKS_API_BASE_URL": "https://hfw-api.hifly.cc/api/v2/hifly", "FLYWORKS_MCP_BASE_PATH": "/path/to/your/output/directory" } } } }

Using in Cursor

Go to Cursor -> Preferences -> Cursor Settings -> MCP -> Add new global MCP Server to add above config.

Make sure to replace your_api_token_here with your actual API token, and update the FLYWORKS_MCP_BASE_PATH to a valid directory on your system where output files will be saved.

Note: We offer free trial access to our tool with the token 2aeda3bcefac46a3. However, please be aware that the daily quota for this free access is limited. Additionally, the generated videos will be watermarked and restricted to a duration of 45 seconds. For full access, please contact us at bd@flyworks.ai to acquire your token.

Installing via Smithery

To install flyworks-mcp for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @Flyworks-AI/flyworks-mcp --client claude

Install locally

  1. Clone this repository:
    git clone https://github.com/yourusername/flyworks-mcp.git
    cd flyworks-mcp
  2. Install dependencies:
    pip install httpx "mcp[cli]>=1.6.0"
    Or using uv:
    uv pip install httpx "mcp[cli]>=1.6.0"
    To avoid timeout issues during server startup, we recommend pre-installing all dependencies:
    pip install pygments pydantic-core httpx "mcp[cli]>=1.6.0"
  3. Configuration

Set your Flyworks API token as an environment variable:

Linux/macOS

export FLYWORKS_API_TOKEN="your_token_here"

Windows (Command Prompt)

set FLYWORKS_API_TOKEN=your_token_here

Windows (PowerShell)

$env:FLYWORKS_API_TOKEN="your_token_here"

Alternatively, you can create a .env file.

  1. Running the Server

Run the server.py file directly:

spawn uvx ENOENT issue:

Please confirm its absolute path by running this command in your terminal:

Once you obtain the absolute path (e.g., /usr/local/bin/uvx), update your configuration to use that path (e.g., "command": "/usr/local/bin/uvx").

Tool Description

1. Create Lipsync Video by Audio (create_lipsync_video_by_audio)

Create a lipsync video with audio input. Animates a digital human avatar to speak in sync with the provided audio.

Parameters:

Notes:

Returns:

2. Create Lipsync Video by Text (create_lipsync_video_by_text)

Create a lipsync video with text input. Generates audio from the text and animates a digital human avatar to speak it.

Parameters:

Notes:

Returns:

Checking Task Status

For tasks run in async mode, you can check their status using the Flyworks API's /creation/task endpoint with the task_id returned by the tool.

Notes