版本變更

概覽

交互示例

接入準備

1. 需要接入方提前準備阿里云賬號，并利用阿里云子賬號生成對應的AK/SK；

2. 阿里云主賬號需要對生成AK/SK的子賬號進行RAM授權；

3. 使用阿里云主賬號登錄平臺，簽署相關法務協議。

API詳情

1. 提交數字人視頻合成任務

SubmitProjectTask

1.1. 入參

OpenFrame

OpenVideoScript

OpenLayer

背景圖層必須鋪滿整個畫面，默認最底層

• 背景圖層的width，height默認等于畫面的width，height

• 背景圖層的positionX，positionY默認等于0

OpenMaterial 主播/素材

OpenSubtitle 字幕

1.1.1. 字體說明

• Alibaba PuHuiTi - 阿里巴巴普惠體

• FZKai-Z03S - 方正楷體簡體

• FZHei-B01S - 方正黑體簡體

• FZShuSong-Z01S - 方正書宋簡體

• FZFangSong-Z02S - 方正仿宋簡體

• SimSun - 宋體

• WenQuanYi MicroHei - 文泉驛微米黑

• WenQuanYi Zen Hei Mono - 文泉驛等寬正黑

• WenQuanYi Zen Hei Sharp - 文泉驛點陣正黑

• Microsoft YaHei - 微軟雅黑

• Yuanti SC - 圓體-簡常規體

• Roboto Bold - Google Robota字體，不支持中文

• Roboto - Google Robota字體，不支持中文

• KaiTi - 楷體

• SiYuan Heiti - 思源黑體

• SiYuan SimSun - 思源宋體

• HappyZcool-2016 - 站酷快樂體

1.1.2. 坐標說明

• 主播、素材、水印坐標參數均為畫面左上角對接圖片左上角的距離

• 坐標如果存在小數，舍棄小數， 如下圖：X=470, Y=700

1.1.3. 圖層超出畫面外

• 超出畫面的圖片需要進行裁剪

• 圖片的寬高使用裁剪后的圖片寬高

• X,Y軸的坐標超出部分為0

原圖：

裁剪后圖片：

畫面內的效果：

1.1.4. 字幕說明

下圖參數示例：

{
    "positionX": 68, // 字幕不允許超出畫面外，最小0，最大不超過畫面寬度
    "positionY": 392,// 字幕不允許超出畫面外，最小0，最大不超過畫面高度
    "maxCharLength": 7, // 一行可顯示最大字數，建議文本寬度/字體寬度
    "textWidth": 800, // 文本寬度，文本框不能超出畫面外
    "textHeight": 110, // 文本高度，必須大于字體大小
    "fontSize": 100, // 字體大小
    "font": "SiYuan SimSun",
    "fontColor": "#090707",
    "alignment": "BottomRight", // 右對齊
    "backgroundColor": "#fefefe"
}

1.1.5. 背景示例

背景圖層提供的圖片需要充滿整個畫布，無需傳遞坐標值，系統默認X=0, Y=0

1.1.6. 變音規則介紹

OpenVideoScript對象的類型為文本（TEXT）的時候可以支持變音配置，需要變音的時候OpenVideoScript的參數speechOpen需設置為true，textContent字段需要設置在變音標簽下面，具體規則如下：

完整示例：

String textContent = "<speak> <sub alias="替換">我是文本替換</sub> <phoneme alphabet="ipa"ph="?">a</phoneme>，apple.是蘋果的意思<phoneme alphabet="py"ph="xi1">茜</phoneme>公主 , 南京市<word>長江大橋</word>。今天天氣<break time="2.5s" />很好 </speak>"

1.1.7. 學術音標表

1.2. 出參

2. 查詢數字人視頻合成信息

GetProjectTask

2.1. 入參

2.2. 出參

3. 批量查詢數字人視頻合成信息

BatchGetProjectTask

3.1. 入參

3.2. 出參

Object說明

4. 合成任務停止

StopProjectTask

4.1. 入參

4.2. 出參

5. 查詢資源信息

5.1. 入參

無

5.2. 出參

ResourceInfo

6. 數字人形象模型查詢

ListAnchor

6.1. 入參

6.2. 出參

AnchorResponse

7. 聲音模板查詢

ListVoiceModels

7.1. 入參

7.2. 出參

VoiceModelResponse

對接詳情

PHP

對接示例

require 'vendor/autoload.php';
use AlibabaCloud\SDK\Imarketing\V20220704\Models\GetOssUploadSignatureRequest;
use AlibabaCloud\SDK\IntelligentCreation\V20240313\IntelligentCreation;
use Darabonba\OpenApi\Models\Config as AlibabaConfig;

$config = new AlibabaConfig();
$config->accessKeyId = '****';
$config->accessKeySecret = '****';
$config->endpoint = "intelligentcreation.cn-zhangjiakou.aliyuncs.com";

$intelligentCreationClient = new IntelligentCreation($config);

$request = new GetProjectTaskRequest();
$request->taskId = '1111';
try {
  $response = $intelligentCreationClient->getProjectTask($request);
  var_dump($response->toMap());
} catch (TeaError $e) {
  Log::error($e);
}

2.6.0

u-2d06dbf9-cce5-4bcf-91b6-750b97fee3bf-composer-tea.zip

composer require alibabacloud/intelligentcreation-20240313 2.6.0

2.4.0

u-17374653-852f-4536-9c8f-61f96b9890ef-composer-tea.zip

composer require alibabacloud/intelligentcreation-20240313 2.4.0

Java

對接示例

package com.aliyun.intelligentcreation20240313;

import com.aliyun.intelligentcreation20240313.models.*;
import com.aliyun.tea.TeaException;
import com.aliyun.teaopenapi.models.Config;
import com.google.gson.Gson;
import com.google.gson.reflect.TypeToken;

import java.util.HashMap;
import java.util.Map;

/**
 * @author fangming.yu
 * @since 2024/7/5
 */
public class TestProjectTest {

    public static void main(String[] args) throws Exception {
        TestProjectTest testProjectTest = new TestProjectTest();

        try {
           String taskId = testProjectTest.submitProjectTaskRequest();
           testProjectTest.stopProjectTaskRequest(taskId);
           testProjectTest.getProjectTaskRequest(taskId);
           testProjectTest.selectResourceRequest(null);
            testProjectTest.listVoiceModelsRequest();
            System.out.println(taskId);
        } catch (TeaException e) {
            Gson gson = new Gson();
            System.out.println(e.getMessage());
            System.out.println(gson.toJson(e.getData()));
        } catch (Exception e) {

            e.printStackTrace();
        }


    }

    String url = "intelligentcreation.cn-zhangjiakou.aliyuncs.com";
    //初始化配置
    Config config = new Config().setAccessKeyId("**")
            .setAccessKeySecret("**")
            .setEndpoint(url);
    // 創建客戶端
    Client client = new Client(config);

    public TestProjectTest() throws Exception {
    }


    String submitProjectTaskRequest() throws Exception {
        Gson gson = new Gson();
        String para = "{\"scaleType\":\"16:9\",\"subtitleTag\":1,\"frames\":[{\"index\":1,\"layers\":[{\"type\":\"BACKGROUND\",\"material\":{\"format\":\"image/png\",\"url\":\"https://yic-pre.oss-cn-hangzhou.aliyuncs.com/common/image/backgroundImage/shu/1.png\"}},{\"type\":\"MATERIAL\",\"material\":{\"format\":\"image/png\",\"url\":\"https://yic-pre.oss-cn-hangzhou.aliyuncs.com/1539704706413278/image/material/1716348615967-%E5%86%B0%E6%B7%87%E6%B7%8B.png\"},\"index\":2,\"positionX\":76,\"positionY\":1169,\"width\":549,\"height\":750},{\"type\":\"ANCHOR\",\"material\":{\"id\":\"759459670880206851\",\"url\":\"https://yic-pre.oss-cn-hangzhou.aliyuncs.com/1539704706413278/image/anchor/1715148681933-55254f81420c4c82954042414136e52d.png\"},\"index\":3,\"positionX\":0,\"positionY\":0,\"width\":1080,\"height\":1920},{\"type\":\"WATERMARK\",\"material\":{\"type\":\"WATERMARK\",\"format\":\"image/png\",\"url\":\"https://yic-pre.oss-cn-hangzhou.aliyuncs.com/common/image/material/%E6%B0%B4%E5%8D%B003%403x.png"},\"index\":4,\"positionX\":248,\"positionY\":280,\"width\":191,\"height\":195}],\"videoScript\":{\"textContent\":\"讓我們一同投身于這場激動人心的呼吸之旅，共同見證科技與醫學的完美融合，攜手共進\",\"type\":\"TEXT\",\"voiceTemplateId\":82,\"volume\":50,\"speedRate\":1.5},\"subtitle\":{\"positionX\":0,\"positionY\":545,\"maxCharLength\":6,\"textWidth\":1080,\"fontSize\":60,\"font\":\"Microsoft YaHei\",\"fontColor\":\"#2a313d\",\"textHeight\":70,\"alignment\":\"BottomCenter\"}}]}";

        Map<String, Object> map = gson.fromJson(para, new TypeToken<Map<String, Object>>() {
        }.getType());

        SubmitProjectTaskRequest request = SubmitProjectTaskRequest.build(map);
        // 請求接口
        SubmitProjectTaskResponse response = client.submitProjectTask(request);

        System.out.println(gson.toJson(response));

        if (response.getStatusCode().equals(200)) {
            System.out.println("submitProjectTaskRequest 請求成功");
            return response.getBody().getTaskId();
        }
        return null;
    }

    void getProjectTaskRequest(String taskId) throws Exception {
        Gson gson = new Gson();

        Map<String, Object> map = new HashMap<>();
        map.put("taskId", taskId);

        GetProjectTaskRequest request = GetProjectTaskRequest.build(map);
        // 請求接口
        GetProjectTaskResponse response = client.getProjectTask(request);

        System.out.println(gson.toJson(response));

        if (response.getStatusCode().equals(200)) {
            System.out.println("getProjectTaskRequest 請求成功");
        }
    }

    void stopProjectTaskRequest(String taskId) throws Exception {
        Gson gson = new Gson();

        Map<String, Object> map = new HashMap<>();
        map.put("taskId", taskId);

        StopProjectTaskRequest request = StopProjectTaskRequest.build(map);
        // 請求接口
        StopProjectTaskResponse response = client.stopProjectTask(request);

        System.out.println(gson.toJson(response));

        if (response.getStatusCode().equals(200)) {
            System.out.println("stopProjectTaskRequest 請求成功");
        }
    }

    void selectResourceRequest(String projectId) throws Exception {
        Gson gson = new Gson();
        Map<String, Object> map = new HashMap<>();
        SelectResourceRequest request = SelectResourceRequest.build(map);
        SelectResourceResponse response = client.selectResource(request);

        System.out.println(gson.toJson(response));
        if (response.getStatusCode().equals(200)) {
            System.out.println("selectResourceRequest 請求成功");
        }
    }

    void listVoiceModelsRequest() throws Exception {
        Gson gson = new Gson();
        Map<String, Object> map = new HashMap<>();
        map.put("useScene", "offlineSynthesis");
        map.put("pageSize", 1);
        map.put("pageNumber", 10);
        ListVoiceModelsRequest request = ListVoiceModelsRequest.build(map);
        ListVoiceModelsResponse response = client.listVoiceModels(request);

        System.out.println(gson.toJson(response));
        if (response.getStatusCode().equals(200)) {
            System.out.println("listVoiceModelsRequest 請求成功");
        }
    }
}

2.6.0

u-2d06dbf9-cce5-4bcf-91b6-750b97fee3bf-java-tea.zip

<dependency>
  <groupId>com.aliyun</groupId>
  <artifactId>intelligentcreation20240313</artifactId>
  <version>2.6.0</version>
</dependency>

2.4.0

u-17374653-852f-4536-9c8f-61f96b9890ef-java-tea.zip

<dependency>
  <groupId>com.aliyun</groupId>
  <artifactId>intelligentcreation20240313</artifactId>
  <version>2.4.0</version>
</dependency>