Sur d’autres sites (9412)

• Need to extract text from any audio file

  20 novembre 2018, par mystack flow

  I am trying to extract the text from audio file. I tried with FreeTTS, but i can able to do Text to Speech.

  here is my code,

  package video_audio_text.project;
  
  
  
  import javax.sound.sampled.AudioFileFormat.Type;
  
  import com.sun.speech.freetts.FreeTTS;
  
  import com.sun.speech.freetts.Voice;
  
  import com.sun.speech.freetts.VoiceManager;
  
  import com.sun.speech.freetts.audio.AudioPlayer;
  
  import com.sun.speech.freetts.audio.SingleFileAudioPlayer;
  
  
  
  public class AudioToText {
  
  
  
      /**
  
       * Example of how to list all the known voices.
  
       */
  
  
  
  
  
      public static void main(String[] args) {
  
  
  
         // listAllVoices();
  
          System.setProperty("freetts.voices", "com.sun.speech.freetts.en.us.cmu_us_kal.KevinVoiceDirectory");
  
  
  
          FreeTTS freetts;
  
          AudioPlayer audioPlayer = null;
  
          String voiceName = "kevin16";
  
  
  
          System.out.println();
  
          System.out.println("Using voice: " + voiceName);
  
  
  
          /* The VoiceManager manages all the voices for FreeTTS.
  
           */
  
          VoiceManager voiceManager = VoiceManager.getInstance();
  
          Voice helloVoice = voiceManager.getVoice(voiceName);
  
  
  
          if (helloVoice == null) {
  
              System.err.println(
  
                  "Cannot find a voice named "
  
                  + voiceName + ".  Please specify a different voice.");
  
              System.exit(1);
  
          }
  
  
  
          /* Allocates the resources for the voice.
  
           */
  
          helloVoice.allocate();
  
  
  
          /* Synthesize speech.
  
           */
  
  //create a audioplayer to dump the output file
  
         audioPlayer = new SingleFileAudioPlayer("/Users/user/Documents/test",Type.WAVE);
  
  //attach the audioplayer 
  
         helloVoice.setAudioPlayer(audioPlayer);
  
  
  
  
  
          helloVoice.speak("Thank you for giving me a voice. "
  
                           + "I'm so glad to say hello to this world." + 
  
                          + "here you go good way");
  
  
  
  
  
  
  
          /* Clean up and leave.
  
           */
  
          helloVoice.deallocate();
  
          audioPlayer.close();
  
          System.exit(0);
  
      }
  
  
  
  }

  But i need to give the audio file and extract text from the audio file.

  Please suggest me how can I achieve.

  please suggest which library like FFMPEG or any other library which can help me to achieve this.

• GoPro (MP4) video timestamp sync with precision of milliseconds

  3 février 2021, par Raphael Ottoni

  I need your help with a data sync problem... I m currently trying to sync my GoPro video with real world time (a.k.a my notebook). I manage to sync date and time of my notebook and my GoPro 3+ black perfectly. The problem is that when the GoPro save the files in disk it round up the milliseconds on the creation_time (the milliseconds is always 000000) . Thus, turning the perfect sync impossible. In attachment is a picture of the meta information (extracted by ffprobe) of the MP4 video.

  



  My question is : What I have to do, so the GoPro actually save the creation_time with precision of milliseconds ?

  



  Another small question : Looking at the attachment figure, we see the "timecode" which is a time synchronization data in the format of hours:minuts:seconds:frame. I was thinking that I could use the "frame" value to calculate the missing milliseconds value. If we take this attachment, as a example, we can see that the frame value is "36". Meaning that the millisecond that it started to record was the one associated with the 36th frame of the FPS (in this video : 60fps) value : Some thing like 1000/60 * 36 which is 600 milliseconds, thus the actual creation_time of this video would be : 2017-07-19T18:10:34.600

  



  Is this logic right ? it didn't work ! I don't know what else to do.

  



  P.S : I need this kind of time precision because I will sync the video frames with a external sensor data that is recorded at 11hz.

  



  Please Help

  



  

  



  update

  



  I forgot to mention, even if you check the original raw file information, inside the GoPro SSD card, using "stats" to read the creation time (see attachment) it still has the same timestamp without milliseconds.

  



  

  


• Use FFMPEG to Save Live CCTV Video Streams that Has Wrong FPS Encoded, Published by Video Clips instead of Frames, and With Nonnegligible Frame Loss

  6 mars 2023, par Crear

  I want to use FFMPEG command line to archive live CCTV video stream (no audio) from Newark Citizen Virtual Patrol (https://cvp.newarkpublicsafety.org) for traffic analysis, previously I was using (I'm just a noob in these commands)
os.system('ffmpeg -t 24:00:00 -i '+address+' -hide_banner -c:v copy -s 640x360 -segment_time 00:15:00 -f segment -strftime 1 -reset_timestamps 1 "'+OutPath+camera_location+'_%Y-%m-%d-%H-%M-%S.mp4"') to archive the videos everyday and segment them into 15-min-long videos.

  


  However, there are several issues.

  


  

  1. The FPS read from the video stream is actually slower than it really is. For example, it's actually 12, but the decoded result says 8, so every time it generates a 15-min-long video, it only pasts 10 11 mins in the real world.

  


  2. Due to unstable frame loss, the FPS is not a stable value either. Therefore, when I manually set the FPS, it usually make the video has wrong length, and sometimes when the stream froze, it keeps waiting because it hasn't finished 15-min-long video. Something I noticed is that it may generate a 15-min-long video, which contains both night and day, started from perhaps 2AM but ended at 8AM.

  


  3. The live CCTV video stream is not frame by frame, but video clip by video clip. Therefore, when I set the -use_wallclock_as_timestamps to 1, the video will be ultra-fast playing the short video clip, then frozen for the rest of time until receiving next video clip.

  


  


  The only thing I can think of is to re-distribute the frames evenly between the timestamp of receiving the current video clip and the timestamp of receiving the prior video clip. What parameters can help FFMPEG to fix the FPS and archive correctly ? I am using FFMPEG to save the video instead of using OpenCV to decode the frame and then encode a video because we have huge amounts of cameras and our legacy Xeon processor had trouble encoding so many frames simultaneously.

  


  Any suggestion is appreciated !