Recherche avancée

Sur d’autres sites (11606)

• Popen ffmpeg process hang if run in shell and leaves a defunct process if run in background

  12 janvier 2023, par dr__noob

  I have a script that runs the FFmpeg command. When I run the command in the background using the & operator it runs fine but leaves a zombie process. And when I remove the operator the process hangs and goes into the pipe_wait state.

  


  The code used to execute the FFmpeg command

  


  def run_cmd(cmd:str,
            check:bool=False,       
            capture:bool=False,
            timeout:float=None,
            ) -> tuple[int,bytearray,bytearray]:
    import  subprocess

    stdout_data,stderr_data = (bytearray(),bytearray()) if capture else (None,None)
    try:
        sp = subprocess.Popen(cmd, shell=True, stdout=subprocess.PIPE, stderr=subprocess.PIPE, )
        while any(data:=(sp.stdout.readline(),sp.stderr.readline())):
            out,err = data
            if out: stdout_data += out
            if err: stderr_data += err
        sp.communicate(timeout=timeout)
        return sp.returncode,stdout_data,stderr_data
    except subprocess.CalledProcessError as e:
        print("Called process error")
        raise e
    except subprocess.TimeoutExpired as e:
        sp.kill()
        print(f"{sp.pid} killed")
        if check:
            raise e
    except PermissionError as e:
        print("Permission error")
        if check:
            raise e


  


  The command which is causing the issue is

  


  nice -n 10 ffmpeg -loglevel verbose -hide_banner -y -threads 0 -i "/dev/shm/480TEST-1999963.dfw.480_1673030704/SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p.intermediate.mp4" -map 0:v:0? -q:v 1 -f rawvideo -pix_fmt "yuv420p" -an ./SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p_fifo_video.yuv -map 0:a:0? -q:a 1 -ac 2 -af "aresample=async=1:first_pts=0" -vn ./SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p_fifo_audio.wav > "./SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p.ffmpeg.demux.log" 2>&1 &


  


  However, other FFmpeg commands are running fine without the last &. But this command will block if I remove the &. If I keep it as it is, the process will later become a zombie(defunct). Can it be because it is actually a nice -n 10 causing the issue ?

  


  Example of a command running fine

  


  ffmpeg -loglevel verbose -hide_banner -y -threads 0 -i "./SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p.ts" -r "59.94" -s:v "1280"x"720" -pix_fmt "yuv420p" -vcodec libx264 -x264-params qp="30" -af "aresample=async=1:first_pts=0" -crf 0 -q:a 1 -vf yadif=1 ./SBS_Plus_Test_Feed.480TEST-1999963.480.eng.p.intermediate.mp4 > "./p.intermediate.mp4.intermediate.ffmpeg.log" 2>&1


  


  Till now I have tried other options like -nostdin and null suggested in ffmpeg hangs when run in background

  


  Is there any other way run this without creating a zombie ?

  


• How to gracefully terminate ffmpeg process alongside with ffprobe process ?

  26 mars 2023, par duruburak

  I was able to terminate ffmpeg process gracefully when it's the only ongoing process. Now I also have ffprobe process alongside with ffmpeg process that tracks the progress of the ffmpeg process. It throws the following exception when I try to cancel the process. I tried to put the statements inside try & except blocks but I don't think it's a good solution. What's the proper way to achieve this job ?

  


  P.S. The code might be a bit confusing, but I tried to create a small executable form out of my actual code, sorry about that.

  


  import subprocess as sp
import shlex
import json
import time
import threading

def start_ffmpeg_thread(audio_part, video_part, path):

    global ffmpeg_process
    if (ffmpeg_process is None) or ffmpeg_process.poll():
        data = sp.run(shlex.split(f'ffprobe -v error -select_streams v:0 -count_packets -show_entries stream=nb_read_packets -of csv=p=0 -of json "{video_part}"'), stdout=sp.PIPE).stdout
        dict = json.loads(data)
        tot_n_frames = float(dict['streams'][0]['nb_read_packets'])

        ffmpeg_process = sp.Popen(shlex.split(f'ffmpeg -y -loglevel error -i "{video_part}" -i "{audio_part}" -progress pipe:1 "{path}"'), stdout=sp.PIPE, stdin=sp.PIPE)

        q = [0]

        ffmpeg_progress_reader_thread = threading.Thread(target=ffmpeg_progress_reader, args=(ffmpeg_process, q))
        ffmpeg_progress_reader_thread.start()

        while True:
            if ffmpeg_process.poll() is not None:
                break

            n_frame = q[0]
            progress_percent = (n_frame/tot_n_frames)*100
            print(f"Progress: [%] {progress_percent}", end="\r")
        ffmpeg_progress_reader_thread.join()

def ffmpeg_progress_reader(procs, q):

    while True:
        if procs.poll() is not None:
            break

        progress_text = procs.stdout.readline()
        progress_text = progress_text.decode("utf-8")
        if progress_text.startswith("frame="):
            frame = int(progress_text.partition('=')[-1])
            q[0] = frame

def cancel_ffmpeg():

    time.sleep(10)
    global ffmpeg_process
    if (ffmpeg_process is not None) and (ffmpeg_process.poll() is None):
            ffmpeg_process.stdin.write('q'.encode("GBK"))
            ffmpeg_process.communicate()
            ffmpeg_process.wait()
            ffmpeg_process = None


ffmpeg_process = None

threading.Thread(target=cancel_ffmpeg).start()
start_ffmpeg_thread(<>, <>, <>)


  


  Exception in thread Thread-2 (ffmpeg_progress_reader):&#xA;Traceback (most recent call last):&#xA;  File "D:\Python311\Lib\threading.py", line 1038, in _bootstrap_inner&#xA;    self.run()9.354796147248976&#xA;  File "D:\Python311\Lib\threading.py", line 975, in run&#xA;    self._target(*self._args, **self._kwargs)&#xA;  File "d:\Python Projects\main.py", line 82, in ffmpeg_progress_reader&#xA;    progress_text = procs.stdout.readline()&#xA;                    ^^^^^^^^^^^^^^^^^^^^^^^&#xA;ValueError: PyMemoryView_FromBuffer(): info->buf must not be NULL&#xA;Traceback (most recent call last):&#xA;  File "d:\Python Projects\main.py", line 101, in <module>&#xA;    start_ffmpeg_thread("aud.mp3", "vid.mp4", "output.mp4")&#xA;  File "d:\Python Projects\main.py", line 69, in start_ffmpeg_thread&#xA;    if ffmpeg_process.poll() is not None:&#xA;       ^^^^^^^^^^^^^^^^^^^&#xA;AttributeError: &#x27;NoneType&#x27; object has no attribute &#x27;poll&#x27;&#xA;</module>

  


• Revision 71554 : Google buzz ne fonctionne plus Désolé, Google Reader n’accepte plus le ...

  4 avril 2013, par kent1@… — Log

  Google buzz ne fonctionne plus
  Désolé, Google Reader n’accepte plus le favori intelligent "Noter dans Google Reader".