Recherche avancée

Sur d’autres sites (6603)

• Is there a way to work with fluent-ffmpeg library for audio encoding (webm to wav/mp3) in Angular 2+ ?

  24 avril 2019, par binarysynthesis

  So i’m using Browser media objects to record audio using microphone for speech to text transcription. The recorded media gives me a blob/file which is in webm format. I want to convert the blob/file to wav or mp3 format which will be sent to AWS S3 Storage from where i intend to use the AWS Transcribe (Speech to Text) service to pick up the file and produce a transcript of the speech. AWS Transcribe doesn’t support webm format due to which i need to encode the audio on the client side to either wav or mp3. I’m trying to use the fluent-ffmpeg (third-party) [https://www.npmjs.com/package/fluent-ffmpeg] npm library to accomplish that but i keep getting the following error in the Typescript compiler when building using ng serve. I have already tried using the RecorderJS and the WebAudioRecoderJS npm libraries and i get the same ’Module not found’ error. -

  ERROR in ./node_modules/fluent-ffmpeg/index.js
  
  Module not found: Error: Can't resolve './lib-cov/fluent-ffmpeg' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/ffprobe.js
  
  Module not found: Error: Can't resolve 'child_process' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/processor.js
  
  Module not found: Error: Can't resolve 'child_process' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/utils.js
  
  Module not found: Error: Can't resolve 'child_process' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/recipes.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/capabilities.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/processor.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/isexe/index.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\isexe'
  
  ERROR in ./node_modules/isexe/windows.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\isexe'
  
  ERROR in ./node_modules/isexe/mode.js
  
  Module not found: Error: Can't resolve 'fs' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\isexe'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/utils.js
  
  Module not found: Error: Can't resolve 'os' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/recipes.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/fluent-ffmpeg.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/capabilities.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/processor.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/options/misc.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib\options'
  
  ERROR in ./node_modules/which/which.js
  
  Module not found: Error: Can't resolve 'path' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\which'
  
  ERROR in ./node_modules/fluent-ffmpeg/lib/recipes.js
  
  Module not found: Error: Can't resolve 'stream' in 'C:\Users\banshuman\Desktop\AWS-Transcribe-Angular\aws-transcribe-angular\node_modules\fluent-ffmpeg\lib'
  
  i ｢wdm｣: Failed to compile.

  I am using Angular 7.2.0 and TypeScript 3.2.4.
  I have also installed the type definitions for fluent-ffmpeg [https://www.npmjs.com/package/@types/fluent-ffmpeg] within the node_modules to specify the typings for TypeScript.
  Below is my angular component file where i have implemented the audio recording functionality in the Browser -

  /// <reference types="@types/dom-mediacapture-record"></reference>
  
  import { Component } from '@angular/core';
  
  import * as aws from 'aws-sdk';
  
  import * as TranscribeService from 'aws-sdk/clients/transcribeservice';
  
  import * as Ffmpeg from 'fluent-ffmpeg';
  
  
  
  @Component({
  
    selector: 'app-root',
  
    templateUrl: './app.component.html',
  
    styleUrls: ['./app.component.css']
  
  })
  
  export class AppComponent {
  
  
  
    speechToText() {
  
  
  
      console.log(Ffmpeg);     
  
  
  
      // Begin streaming audio
  
      navigator.mediaDevices.getUserMedia({ audio: true })
  
        .then(stream => {
  
          const mediaRecorder = new MediaRecorder(stream);
  
          // Start recording audio
  
          mediaRecorder.start();
  
  
  
          const audioChunks = [];
  
          // When recording starts
  
          mediaRecorder.addEventListener("dataavailable", event => {
  
            audioChunks.push((<any>event).data);
  
          });
  
  
  
  
  
          // When recording stops
  
          mediaRecorder.addEventListener("stop", () => {
  
            const audioBlob = new Blob(audioChunks, { type: 'audio/webm;codecs=opus' });
  
            const audioFile = new File([audioBlob], 'outputAudioFile');
  
            const audioUrl = URL.createObjectURL(audioBlob);
  
  
  
  </any>

  I’m not posting the entire component code as the rest is part of the AWS SDK and is irrelevant to the problem statement. I need to convert the audioBlob or the audioFile which are currently in the webm format to wav or mp3 for uploading to the AWS services. How can i achieve that in Angular using the ffmpeg library ? I’m open to other solutions as well and not just ffmpeg to get the job done on the client side.

• array_merge() : Argument #2 is not an array after adding class into providers

  19 juin 2019, par Daman Mokha

  I am using pbmedia/laravel-ffmpeg as soon as I installed and added the providers and alias, it shows me the following error. This code was simply working on another machine

  array_merge(): Argument #2 is not an array

  I have tried the following things

  1. Composer update/ and Fresh install
  2. Cleaning the bootstrap/cache/
  3. Checked the config file for laravel-ffmpeg it’s there and fine
  4. Publish the config file using the artisan CLI tool : php artisan vendor:publish —provider="Pbmedia\LaravelFFMpeg\FFMpegServiceProvider"

  Here is the portion from laravel.log when I tried to run.

  [2019-06-19 00:34:40] local.ERROR: ErrorException: array_merge(): Argument #2 is not an array in /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Support/ServiceProvider.php:59
  
  Stack trace:
  
  #0 [internal function]: Illuminate\Foundation\Bootstrap\HandleExceptions->handleError(2, 'array_merge(): ...', '/Users/damanmok...', 59, Array)
  
  #1 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Support/ServiceProvider.php(59): array_merge(Array, 1)
  
  #2 /Users/damanmokha/edetyv2/vendor/pbmedia/laravel-ffmpeg/src/FFMpegServiceProvider.php(25): Illuminate\Support\ServiceProvider->mergeConfigFrom('/Users/damanmok...', 'laravel-ffmpeg')
  
  #3 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Application.php(565): Pbmedia\LaravelFFMpeg\FFMpegServiceProvider->register()
  
  #4 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/ProviderRepository.php(74): Illuminate\Foundation\Application->register(Object(Pbmedia\LaravelFFMpeg\FFMpegServiceProvider))
  
  #5 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Application.php(540): Illuminate\Foundation\ProviderRepository->load(Array)
  
  #6 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Bootstrap/RegisterProviders.php(17): Illuminate\Foundation\Application->registerConfiguredProviders()
  
  #7 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Application.php(203): Illuminate\Foundation\Bootstrap\RegisterProviders->bootstrap(Object(Illuminate\Foundation\Application))
  
  #8 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php(267): Illuminate\Foundation\Application->bootstrapWith(Array)
  
  #9 /Users/damanmokha/edetyv2/vendor/laravel/framework/src/Illuminate/Foundation/Console/Kernel.php(113): Illuminate\Foundation\Console\Kernel->bootstrap()
  
  #10 /Users/damanmokha/edetyv2/artisan(35): Illuminate\Foundation\Console\Kernel->handle(Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
  
  #11 {main} 

  if I don’t add these providers it works fine, but then I am not able to use ffmpeg without that.

  • Laravel Version 5.3
  • pbmedia/laravel-ffmpeg 1.3
  • php version : 7.1

• How do video encoding standards(like h.264) then serialize motion prediction ?

  12 août 2019, par Nephilim

  Motion prediction brute force algorithms, in a nutshell work like this(if I'm not mistaken) :

  



  

  1. Search every possible macroblock in the search window

  


  2. Compare each of them with the reference macroblock

  


  3. Take the one that is the most similar and encode the DIFFERENCE between the frames instead of the actual frame.

  


  



  Now this in theory makes sense to me. But when it gets to the actual serializing I'm lost. We've found the most similar block. We know where it is, and from that we can calculate the distance vector of it. Let's say it's about 64 pixels to the right.

  



  Basically, when serializing this block, we do :

  



  

  • Ignore everything but luminosity(encode only Y, i think i saw this somewhere ?), take note of the difference between it and the reference block

  


  • Encode the motion, a distance vector

  


  • Encode the MSE, so we can reconstruct it

  


  



  Is the output of this a simple 2D array of luminosity values, with an appended/prepended MSE value and distance vector ? Where is the compression in this ? We got to take out the UV component ? There seem to be many resources that take on the surface level of video encoders, but it's very hard to find actual in-depth explanations of modern video encoders. Feel free to correct me on my above statements.