From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ffbox0-bg.mplayerhq.hu (ffbox0-bg.ffmpeg.org [79.124.17.100]) by master.gitmailbox.com (Postfix) with ESMTP id 7232C43DC9 for ; Mon, 6 Nov 2023 15:20:00 +0000 (UTC) Received: from [127.0.1.1] (localhost [127.0.0.1]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTP id 16E6B68020E; Mon, 6 Nov 2023 17:19:37 +0200 (EET) Received: from EUR03-DBA-obe.outbound.protection.outlook.com (mail-dbaeur03on2063.outbound.protection.outlook.com [40.107.104.63]) by ffbox0-bg.mplayerhq.hu (Postfix) with ESMTPS id 0B21C68CA9B for ; Mon, 6 Nov 2023 17:19:34 +0200 (EET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=T0bGWaZd0Z93LMHo36+zv09ZlqdZP6/t6hY+b5b51MMcd385OVFMWAl7wnfyQM0zPPnI4ivJBUJjuG56mnG654JQ+btzj04Pd+smb1MmatvxEA685AfHIvFAtRsYHSsF4wESFCFvoGwuDqrVeWNbFdeMXgpq95W8qduR6DMZdEvVHNrcAHw0OK3Hs5COKrFtUvl2hY7/14OSb3ilrtrebjU8NK7vmgLKN6Khc4nQG20a0k6YBTR6pYc941iIjG2CcXFJHf/zuG5RIsnmgM28Epz22itbVRkivW434ElqsqoQYsMMWU98EcMcXPjo9vK8LktvY8rfeeKoWCkHLgvWwQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Bg5YbSr7kygp4VR/dc4LYLVto2UQLRJf0K5I/qxNMx4=; b=iLyPC1FtwYWCeBBYhpSPUIBfatCkSyRhV/H/97+If0d7qlSrczQO7nh8Vy5BSgr29+mUjL3/OCwqEwFSRxKHI7TufPMcm+RUpNRAtiX59g0rxfLmKPKxtUGmpZA5f2dFx2F43Q5TqEcWkZLoFoifiaG8zCqCdfJF5xO97CF7l91IxTZTg5P/plFhBRgtWpRCu07Sjk9PboJLIi8HFWZ2hYd0Faifjxz6AgPvfSA/CgBSGZ6+X+vI6O4jSxD1VaOxRR51ty9L2Xh9wpIlraXq1Pr8B9OFFZ/yfb5A6IABsMLboMeIpqWDaOHSxIjDksbGE90jQ9WkAukpwGznhxfkFg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nativewaves.com; dmarc=pass action=none header.from=nativewaves.com; dkim=pass header.d=nativewaves.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nativewaves.onmicrosoft.com; s=selector2-nativewaves-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Bg5YbSr7kygp4VR/dc4LYLVto2UQLRJf0K5I/qxNMx4=; b=EnDXYx7TswIYrA/qsmXdpavyR2fPcbDQ2ye2yUB5fC/lDqJo4VEd70y3PAW6v9POjfk4yYFO6NME+DhDDwqV+F4I72p7P5pK394pAGQGKsxfFtZQIKDznUQrUMIRSFkzRmk1HVyu3VkIUKFIBwJW+8jxnL/tWEAd5260mreyfIE= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nativewaves.com; Received: from VI1PR03MB4239.eurprd03.prod.outlook.com (2603:10a6:803:5f::26) by PAVPR03MB10143.eurprd03.prod.outlook.com (2603:10a6:102:327::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6954.28; Mon, 6 Nov 2023 15:19:30 +0000 Received: from VI1PR03MB4239.eurprd03.prod.outlook.com ([fe80::150d:b41:699f:42b6]) by VI1PR03MB4239.eurprd03.prod.outlook.com ([fe80::150d:b41:699f:42b6%6]) with mapi id 15.20.6954.028; Mon, 6 Nov 2023 15:19:30 +0000 Message-ID: <01dd330f-2281-4107-92b5-bbe0a293c8dd@nativewaves.com> Date: Mon, 6 Nov 2023 16:19:29 +0100 User-Agent: Mozilla Thunderbird From: Michael Riedl To: ffmpeg-devel@ffmpeg.org Content-Language: en-US X-ClientProxiedBy: VI1PR0102CA0021.eurprd01.prod.exchangelabs.com (2603:10a6:802::34) To VI1PR03MB4239.eurprd03.prod.outlook.com (2603:10a6:803:5f::26) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: VI1PR03MB4239:EE_|PAVPR03MB10143:EE_ X-MS-Office365-Filtering-Correlation-Id: 7a97cde8-1f4b-4e53-b81a-08dbdedbc5b5 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: M5/n3jMaKei4EQiOAa47Vle8ZUJxDdiNEawyAwdtnn9is5u+cvmGas6OGKTabOl3B8ssJUW9NL3isrkHVsNs0Lhdf5HbnIAufo7ewGpuCy970MEzVNMAqklHWfZL/BkwwVPRdEjPGD7B/FNX2MXUvwu+pDcsskNsG+ADi8pT4n6AZ390EYSKHBZJHlu0Yyk9YRJtXxTyf9yg7bRBlc3mobbqy3YYEskTOsgXvcHAhmUfvINALkznYN06AZffQaniRCx+828a/epFzHkBkkcOv13U7/cOY3Qpz95IQz1gE38/hyXPf3ZyQ9rteUFKvgBswTniMEBBWPeeY6UwhDIQugiw7oUW1T6jupx3RfPc0WQmSHBKH+puv0kVTiiZaDOtX05gSR0MlxAhYOMWrEY0yXqZweP1ITUiFRfcxAQqA6sDA+QeCXO0IIypvYxmd1esYf5YjkWjF62651ZzFoVi0X8NM2ZJyn7jI8QH7AMud/DxugP9q6jdV3UYLYxAo4dM9CIIg1JY43f6T7jVla+CvLjjOzdQUkke2A2HdhT2jXtElvuT17+fd1CPcU2aYRIp3iTTpJw60fPBslLkIrbrXspuwmLU2kK87NET+Bgqt9WBP15h5JO8Cz/H/hhGNXAzC18QCLn9+2Uq9OllhfYbOF+PAxzC6u03Btet/kFuU+8oJXTbYPM8yGfsbDC/9oPrjhJW5FXDJ1dKoJaKJlCtDQ== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:VI1PR03MB4239.eurprd03.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(136003)(366004)(396003)(346002)(39830400003)(376002)(230273577357003)(230173577357003)(230922051799003)(186009)(1800799009)(64100799003)(451199024)(66899024)(36756003)(316002)(8936002)(8676002)(83380400001)(26005)(66476007)(66946007)(6916009)(66556008)(30864003)(5660300002)(44832011)(41300700001)(478600001)(6486002)(6512007)(6506007)(2616005)(31686004)(2906002)(31696002)(86362001)(38100700002)(2004002)(43740500002)(45980500001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NlM4MjhtcTErNTZXdUV4V1BUeVZjTGpIWVJmVFE0M3dYT0pxUXo3SXJRMXdx?= =?utf-8?B?MjBtdk0vMVc2MGtpS215VzcvNXlLN05OelJRMVhidmlhRU4ySVFjODhXUmEv?= =?utf-8?B?dWhsTE8yVWt2Z2pNaG5lUFg5ZUJDdURucE80Rmp6RlNHMDdKWUZpUWZoSmsy?= =?utf-8?B?MTQzUTJIUngwdUhSVmFsY1JQVW5NUG1sZW93Q3gxVm9OOG9CajRuYW5YTERm?= =?utf-8?B?UDUwMU1kakJaOWJJRW1ia1FtcWNjcVRpdmJjckl5RlVrUkppd1AxNHJHb1By?= =?utf-8?B?eS9zR3RuWk5OWFpaTWMweGZ3WWFEOTRTdXpxako2M0J3U1ZMbHphaVVuSFZz?= =?utf-8?B?SC9NdHltQTBDenpOb1lFcXZZdUtiSzlnVDQ4aU80dlN5VnRZZ1NONk4wUUkw?= =?utf-8?B?dW9FZjliT1Y4QUpqeXBCY29kQ2gwdXY2ZVc5MHBLc0tSYUtuRjF1dDZwV1Bi?= =?utf-8?B?dXZmUTdlK3dYdFordm5hNEdhOVRYQmErejVjT25INFQ2ekZIQjRkbFdRS1VL?= =?utf-8?B?UVhXNGlBVXdGWTI5cGJocXhNRFFhU3lBcEwyS2duR3JkcDRoQXFMRFU4MDlM?= =?utf-8?B?d2JQSks2empIQnJWZTl1bVZTSTRrNEQ2MjZacEtLU0ZVVWdSby82QlVFMmN1?= =?utf-8?B?M3pueGdHSjl2ekZFY1lESng1NGorUUJNeUxsL2hONjIvbllIcVgzaDYrMmRm?= =?utf-8?B?K2VKWnkvY1YrK2hkVm55Q0VycWxuM3ZlREhmbHU0TlpsREFaQ1dFRmdvTk9X?= =?utf-8?B?Q091dUVSUXFPWi9Id0dDZHExcjNINFVPbHphNVlVQTdZZlF2M2xwVENnM1gv?= =?utf-8?B?a3VoUzJ6aUhMbEgxR0pDUkR5WExCK2lMK0hVZklDdWpGemsveDdmQXFMbHI4?= =?utf-8?B?MzF1YzhoZlBNNndWMHV5U2lXMmRCb3JIcGtoLzRoTk1lYTJOcGlMS2RlQVBw?= =?utf-8?B?bXBaYUlLdnVrUC9HdGZ6N1hqbnUzNzNiV21TNzdHS0luRC9peEpHYjhjY0Ns?= =?utf-8?B?YTBJaThEMGhIbEYxZnhsZ3lpNWw2MEdqKzlNVEd1REM0c3U1aEdoZkdycEkx?= =?utf-8?B?YXYzR2hheFh3QXgvemYxK3AzLzluTEd4QytqSDFYUm1BS05LSkxIU0FsT25P?= =?utf-8?B?NGpWS0oyR1p6dE9EZURHMDVFd0hEcGMrNk51Wi8rZnF6SUQ1emZEVjlNK3dq?= =?utf-8?B?SHhmTWo0bm5VSE54MTZtMjNneVZZcUNlQWN4TmdnWWVtSnV5TVdZVzBPTUw2?= =?utf-8?B?aCtwZjZnMHF6UnpORHhqTnZXVXZzWXp4SEdhUUZDT2ppREtyVGVBVWFJYVAx?= =?utf-8?B?dFBRTUpWajhxN01sUlVsTHcxbHJQREZzb2ZENXUxRkJEeEp1L1Nsa1IrTmdD?= =?utf-8?B?NE1ieHRMZjV4dE84UTFuN1Voc2hFTHRSZzlhVmpXR0J4VDhvclBRRzZYTUNk?= =?utf-8?B?WGFPdlpxcVFETFBSc2VjVmc4ZFVxUTdlZElhVDQvTVZqVmFDT2kyeGZwU3hN?= =?utf-8?B?ZU81UlZOVUNUVmNicmdaQjd2R0RQNElrTk16Ly9Ka2grTExUTHhuWktqWWgx?= =?utf-8?B?YTdURTNxOG8ramFwVFVEaHhtOWhrZjNQV2dRbmpRUXRveitOWkozekpMMHJ1?= =?utf-8?B?TUdoZmpBckc1WWpoa2I3Z2lwbDIrSDBDYmU4Mm1jTzgyUXprOXJCT1o2V3R1?= =?utf-8?B?Yjl2TUxGeHlLd3hHTGtMNVdsRWpqcWFJN2dEdnBJQ2NTTWlqdlpKWDI5WUtC?= =?utf-8?B?bXlMZGtnbFJteFZIMFExcEZKWFRnWlh2T0JBakN0bGZQMDdiN2NOdGtqMG9l?= =?utf-8?B?NkRxS2NsMm5YUksxYVp0RERYUHAzQzk1QkpIamdGcEdzTFR4WmljQWlPTDNT?= =?utf-8?B?TDU2TzFUL1p0OXozcWQ4Rm1oeTUxRGtUQWtYWFVFUFVXWWtKVStkUmo0cGwv?= =?utf-8?B?elRnQzNqdDRzQWdzNnFBcjBrSS9CY2JZZVU4UXFVNHZuZWZoM1MvdVQ4eGw3?= =?utf-8?B?ZjE3SmVNdytXdkJKU2dyaStmakFnSTdCR0t1NTZIVFRvOW9pOUhkKytTTkxK?= =?utf-8?B?aFRNYkErQWt3Y0V0enVaR25vTWMwVC84YXR0ZEU5WnRiRE9SMmZFb0c2MDR0?= =?utf-8?B?R2RFM0xDL0NqZGZ4WklEamxEOXM5aUg1SExQaUxkT1VMZ1VtRGRkZmd1MnJK?= =?utf-8?Q?pOBJ+25ZmHZXSk4ZFw6uTm8=3D?= X-OriginatorOrg: nativewaves.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7a97cde8-1f4b-4e53-b81a-08dbdedbc5b5 X-MS-Exchange-CrossTenant-AuthSource: VI1PR03MB4239.eurprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Nov 2023 15:19:30.5184 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: e4239718-b000-4513-8314-02ef46bd0276 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: zFOSNeI660tdClXka2ODBjsAwHOpu9w60qWsjVcM9ZmfT9p3SInYmPKXigSVDK6Cr+58CuoBI0Y6co+CdhoRmCy8duADhDXDltV7TG9qieY= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAVPR03MB10143 Subject: [FFmpeg-devel] [PATCH 4/6] libavformat/webrtc: add common code for WebRTC streaming X-BeenThere: ffmpeg-devel@ffmpeg.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: FFmpeg development discussions and patches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: FFmpeg development discussions and patches Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ffmpeg-devel-bounces@ffmpeg.org Sender: "ffmpeg-devel" Archived-At: List-Archive: List-Post: Signed-off-by: Michael Riedl --- libavformat/webrtc.c | 398 +++++++++++++++++++++++++++++++++++++++++++ libavformat/webrtc.h | 70 ++++++++ 2 files changed, 468 insertions(+) create mode 100644 libavformat/webrtc.c create mode 100644 libavformat/webrtc.h diff --git a/libavformat/webrtc.c b/libavformat/webrtc.c new file mode 100644 index 00000000000..75884eac46f --- /dev/null +++ b/libavformat/webrtc.c @@ -0,0 +1,398 @@ +/* + * WebRTC-HTTP ingestion/egress protocol (WHIP/WHEP) common code + * + * Copyright (C) 2023 NativeWaves GmbH + * This work is supported by FFG project 47168763. + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software Foundation, + * Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#include "libavutil/avstring.h" +#include "libavutil/opt.h" +#include "libavutil/uuid.h" +#include "libavutil/random_seed.h" +#include "rtpenc_chain.h" +#include "rtsp.h" +#include "webrtc.h" + +static const char* webrtc_get_state_name(const rtcState state) +{ + switch (state) + { + case RTC_NEW: + return "RTC_NEW"; + case RTC_CONNECTING: + return "RTC_CONNECTING"; + case RTC_CONNECTED: + return "RTC_CONNECTED"; + case RTC_DISCONNECTED: + return "RTC_DISCONNECTED"; + case RTC_FAILED: + return "RTC_FAILED"; + case RTC_CLOSED: + return "RTC_CLOSED"; + default: + return "UNKNOWN"; + } +} + +static void webrtc_log(const rtcLogLevel rtcLevel, const char *const message) +{ + int level = AV_LOG_VERBOSE; + switch (rtcLevel) + { + case RTC_LOG_NONE: + level = AV_LOG_QUIET; + break; + case RTC_LOG_DEBUG: + case RTC_LOG_VERBOSE: + level = AV_LOG_DEBUG; + break; + case RTC_LOG_INFO: + level = AV_LOG_VERBOSE; + break; + case RTC_LOG_WARNING: + level = AV_LOG_WARNING; + break; + case RTC_LOG_ERROR: + level = AV_LOG_ERROR; + break; + case RTC_LOG_FATAL: + level = AV_LOG_FATAL; + break; + } + + av_log(NULL, level, "[libdatachannel] %s\n", message); +} + +void webrtc_init_logger(void) +{ + rtcLogLevel level = RTC_LOG_VERBOSE; + switch (av_log_get_level()) + { + case AV_LOG_QUIET: + level = RTC_LOG_NONE; + break; + case AV_LOG_DEBUG: + level = RTC_LOG_DEBUG; + break; + case AV_LOG_VERBOSE: + level = RTC_LOG_VERBOSE; + break; + case AV_LOG_WARNING: + level = RTC_LOG_WARNING; + break; + case AV_LOG_ERROR: + level = RTC_LOG_ERROR; + break; + case AV_LOG_FATAL: + level = RTC_LOG_FATAL; + break; + } + + rtcInitLogger(level, webrtc_log); +} + +int webrtc_generate_media_stream_id(char media_stream_id[37]) +{ + int ret; + AVUUID uuid; + + ret = av_random_bytes(uuid, sizeof(uuid)); + if (ret < 0) { + goto fail; + } + av_uuid_unparse(uuid, media_stream_id); + return 0; + +fail: + return ret; +} + +int webrtc_create_resource(DataChannelContext*const ctx) +{ + int ret; + URLContext* h = NULL; + char* headers; + char offer_sdp[SDP_MAX_SIZE] = { 0 }; + char response_sdp[SDP_MAX_SIZE] = { 0 }; + + /* set local description */ + if (rtcSetLocalDescription(ctx->peer_connection, "offer") != RTC_ERR_SUCCESS) { + av_log(ctx->avctx, AV_LOG_ERROR, "Failed to set local description\n"); + ret = AVERROR_EXTERNAL; + goto fail; + } + + /* create offer */ + ret = rtcGetLocalDescription(ctx->peer_connection, offer_sdp, sizeof(offer_sdp)); + if (ret < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "Failed to get local description\n"); + ret = AVERROR_EXTERNAL; + goto fail; + } + av_log(ctx->avctx, AV_LOG_VERBOSE, "offer_sdp: %s\n", offer_sdp); + + /* alloc the http context */ + if ((ret = ffurl_alloc(&h, ctx->avctx->url, AVIO_FLAG_READ_WRITE, NULL)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_alloc failed\n"); + goto fail; + } + + /* set options */ + headers = av_asprintf("Content-type: application/sdp\r\n"); + if (ctx->bearer_token) { + headers = av_asprintf("%sAuthorization: Bearer %s\r\n", headers, ctx->bearer_token); + } + av_log(ctx->avctx, AV_LOG_VERBOSE, "headers: %s\n", headers); + av_opt_set(h->priv_data, "headers", headers, 0); + av_opt_set(h->priv_data, "method", "POST", 0); + av_opt_set_bin(h->priv_data, "post_data", (uint8_t*)offer_sdp, strlen(offer_sdp), 0); + + /* open the http context */ + if ((ret = ffurl_connect(h, NULL)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_connect failed\n"); + goto fail; + } + + /* read the server reply */ + ret = ffurl_read_complete(h, (unsigned char*)response_sdp, sizeof(response_sdp)); + if (ret < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_read_complete failed\n"); + goto fail; + } + + av_log(ctx->avctx, AV_LOG_VERBOSE, "response: %s\n", response_sdp); + + /* set remote description */ + ret = rtcSetRemoteDescription(ctx->peer_connection, response_sdp, "answer"); + if (ret < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "Failed to set remote description\n"); + goto fail; + } + + /* save resource location for later use */ + av_opt_get(h->priv_data, "new_location", AV_OPT_SEARCH_CHILDREN, (uint8_t**)&ctx->resource_location); + av_log(ctx->avctx, AV_LOG_VERBOSE, "resource_location: %s\n", ctx->resource_location); + + /* close the http context */ + if ((ret = ffurl_closep(&h)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_closep failed\n"); + goto fail; + } + + av_freep(&headers); + return 0; + +fail: + if (h) { + ffurl_closep(&h); + } + av_freep(&headers); + return ret; +} + +int webrtc_close_resource(DataChannelContext*const ctx) +{ + int ret; + URLContext* h = NULL; + char* headers = NULL; + + if (!ctx->resource_location) { + return 0; + } + + /* alloc the http context */ + if ((ret = ffurl_alloc(&h, ctx->resource_location, AVIO_FLAG_READ_WRITE, NULL)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_alloc failed\n"); + goto fail; + } + + /* set options */ + if (ctx->bearer_token) { + headers = av_asprintf("Authorization: Bearer %s\r\n", ctx->bearer_token); + av_log(ctx->avctx, AV_LOG_VERBOSE, "headers: %s\n", headers); + } + av_opt_set(h->priv_data, "method", "DELETE", 0); + + /* open the http context */ + if ((ret = ffurl_connect(h, NULL)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_connect failed\n"); + goto fail; + } + + /* close the http context */ + if ((ret = ffurl_closep(&h)) < 0) { + av_log(ctx->avctx, AV_LOG_ERROR, "ffurl_close failed\n"); + goto fail; + } + +fail: + if (h) { + ffurl_closep(&h); + } + av_freep(&ctx->resource_location); + av_freep(&headers); + return ret; +} + +/* callback for receiving data */ +static int webrtc_read(URLContext *h, unsigned char *buf, int size) +{ + const DataChannelTrack*const ctx = (const DataChannelTrack*const)h->priv_data; + int ret; + + ret = rtcReceiveMessage(ctx->track_id, (char*)buf, &size); + if (ret == RTC_ERR_NOT_AVAIL) { + return AVERROR(EAGAIN); + } + else if (ret == RTC_ERR_TOO_SMALL) { + return AVERROR_BUFFER_TOO_SMALL; + } + else if (ret != RTC_ERR_SUCCESS) { + av_log(ctx->avctx, AV_LOG_ERROR, "rtcReceiveMessage failed: %d\n", ret); + return AVERROR_EOF; + } + return size; +} + +/* callback for sending data */ +static int webrtc_write(URLContext *h, const unsigned char *buf, int size) +{ + const DataChannelTrack*const ctx = (const DataChannelTrack*const)h->priv_data; + int ret; + + ret = rtcSendMessage(ctx->track_id, (const char*)buf, size); + if (ret != RTC_ERR_SUCCESS) { + av_log(ctx->avctx, AV_LOG_ERROR, "rtcSendMessage failed: %d\n", ret); + return AVERROR_EXTERNAL; + } + return size; +} + +static const URLProtocol ff_webrtc_protocol = { + .name = "webrtc", + .url_read = webrtc_read, + .url_write = webrtc_write, +}; + +int webrtc_init_urlcontext(DataChannelContext*const ctx, int track_idx) +{ + DataChannelTrack*const track = &ctx->tracks[track_idx]; + + track->rtp_url_context = av_mallocz(sizeof(URLContext)); + if (!track->rtp_url_context) { + return AVERROR(ENOMEM); + } + + track->rtp_url_context->prot = &ff_webrtc_protocol; + track->rtp_url_context->priv_data = track; + track->rtp_url_context->max_packet_size = RTP_MAX_PACKET_SIZE; + track->rtp_url_context->flags = AVIO_FLAG_READ_WRITE; + track->rtp_url_context->rw_timeout = ctx->rw_timeout; + return 0; +} + +static void webrtc_on_state_change(int pc, rtcState state, void* ptr) +{ + DataChannelContext*const ctx = (DataChannelContext*const)ptr; + + av_log(ctx->avctx, AV_LOG_VERBOSE, "Connection state changed from %s to %s\n", webrtc_get_state_name(ctx->state), webrtc_get_state_name(state)); + ctx->state = state; +} + +int webrtc_init_connection(DataChannelContext *const ctx) +{ + int ret; + rtcConfiguration config = { 0 }; + + if (!(ctx->peer_connection = rtcCreatePeerConnection(&config))) { + av_log(ctx->avctx, AV_LOG_ERROR, "Failed to create PeerConnection\n"); + return AVERROR_EXTERNAL; + } + + rtcSetUserPointer(ctx->peer_connection, ctx); + + if (rtcSetStateChangeCallback(ctx->peer_connection, webrtc_on_state_change)) { + av_log(ctx->avctx, AV_LOG_ERROR, "Failed to set state change callback\n"); + ret = AVERROR_EXTERNAL; + goto fail; + } + + return 0; + +fail: + rtcDeletePeerConnection(ctx->peer_connection); + return ret; +} + +int webrtc_convert_codec(enum AVCodecID codec_id, rtcCodec* rtc_codec) +{ + switch (codec_id) + { + case AV_CODEC_ID_H264: + *rtc_codec = RTC_CODEC_H264; + break; + case AV_CODEC_ID_HEVC: + *rtc_codec = RTC_CODEC_H265; + break; + case AV_CODEC_ID_AV1: + *rtc_codec = RTC_CODEC_AV1; + break; + case AV_CODEC_ID_VP9: + *rtc_codec = RTC_CODEC_VP9; + break; + case AV_CODEC_ID_OPUS: + *rtc_codec = RTC_CODEC_OPUS; + break; + case AV_CODEC_ID_AAC: + *rtc_codec = RTC_CODEC_AAC; + break; + case AV_CODEC_ID_PCM_ALAW: + *rtc_codec = RTC_CODEC_PCMA; + break; + case AV_CODEC_ID_PCM_MULAW: + *rtc_codec = RTC_CODEC_PCMU; + break; + default: + *rtc_codec = -1; + return AVERROR(EINVAL); + } + + return 0; +} + +void webrtc_deinit(DataChannelContext*const ctx) +{ + if (ctx->tracks) { + for (int i = 0; i < ctx->nb_tracks; ++i) { + if (ctx->tracks[i].rtp_ctx) + avformat_free_context(ctx->tracks[i].rtp_ctx); + if (ctx->tracks[i].rtp_url_context) + av_freep(&ctx->tracks[i].rtp_url_context); + if (ctx->tracks[i].track_id) + rtcDeleteTrack(ctx->tracks[i].track_id); + } + av_freep(&ctx->tracks); + } + if (ctx->peer_connection) { + rtcDeletePeerConnection(ctx->peer_connection); + ctx->peer_connection = 0; + } + if (ctx->resource_location) + av_freep(&ctx->resource_location); +} \ No newline at end of file diff --git a/libavformat/webrtc.h b/libavformat/webrtc.h new file mode 100644 index 00000000000..f7d81f3dd0b --- /dev/null +++ b/libavformat/webrtc.h @@ -0,0 +1,70 @@ +/* + * WebRTC-HTTP ingestion/egress protocol (WHIP/WHEP) common code + * + * Copyright (C) 2023 NativeWaves GmbH + * This work is supported by FFG project 47168763. + * + * This file is part of FFmpeg. + * + * FFmpeg is free software; you can redistribute it and/or + * modify it under the terms of the GNU Lesser General Public + * License as published by the Free Software Foundation; either + * version 2.1 of the License, or (at your option) any later version. + * + * FFmpeg is distributed in the hope that it will be useful, + * but WITHOUT ANY WARRANTY; without even the implied warranty of + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + * Lesser General Public License for more details. + * + * You should have received a copy of the GNU Lesser General Public + * License along with FFmpeg; if not, write to the Free Software Foundation, + * Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA + */ + +#ifndef AVFORMAT_WEBRTC_H +#define AVFORMAT_WEBRTC_H + +#include "avformat.h" +#include "avio_internal.h" +#include "libavcodec/codec_id.h" +#include "url.h" +#include "rtc/rtc.h" + +#define RTP_MAX_PACKET_SIZE 1450 + +typedef struct DataChannelTrack { + AVFormatContext *avctx; + int track_id; + AVFormatContext *rtp_ctx; + URLContext *rtp_url_context; +} DataChannelTrack; + +typedef struct DataChannelContext { + AVFormatContext *avctx; + int peer_connection; + rtcState state; + DataChannelTrack *tracks; + int nb_tracks; + const char *resource_location; + + /* options */ + char* bearer_token; + int64_t connection_timeout; + int64_t rw_timeout; +} DataChannelContext; + +#define WEBRTC_OPTIONS(FLAGS, offset) \ + { "bearer_token", "optional Bearer token for authentication and authorization", offset+offsetof(DataChannelContext, bearer_token), AV_OPT_TYPE_STRING, { .str = NULL }, 0, 0, FLAGS }, \ + { "connection_timeout", "timeout for establishing a connection", offset+offsetof(DataChannelContext, connection_timeout), AV_OPT_TYPE_DURATION, { .i64 = 10000000 }, 1, INT_MAX, FLAGS }, \ + { "rw_timeout", "timeout for receiving/writing data", offset+offsetof(DataChannelContext, rw_timeout), AV_OPT_TYPE_DURATION, { .i64 = 1000000 }, 1, INT_MAX, FLAGS } + +extern int webrtc_close_resource(DataChannelContext*const ctx); +extern int webrtc_convert_codec(enum AVCodecID codec_id, rtcCodec* rtc_codec); +extern int webrtc_create_resource(DataChannelContext*const ctx); +extern void webrtc_deinit(DataChannelContext*const ctx); +extern int webrtc_generate_media_stream_id(char media_stream_id[37]); +extern int webrtc_init_connection(DataChannelContext*const ctx); +extern void webrtc_init_logger(void); +extern int webrtc_init_urlcontext(DataChannelContext*const ctx, int track_idx); + +#endif /* AVFORMAT_WEBRTC_H */ -- 2.39.2 _______________________________________________ ffmpeg-devel mailing list ffmpeg-devel@ffmpeg.org https://ffmpeg.org/mailman/listinfo/ffmpeg-devel To unsubscribe, visit link above, or email ffmpeg-devel-request@ffmpeg.org with subject "unsubscribe".