Recherche avancée

Sur d’autres sites (10783)

• Introducing the Data Warehouse Connector feature

  30 janvier, par Matomo Core Team

  Matomo is built on a simple truth : your data belongs to you, and you should have complete control over it. That’s why we’re excited to launch our new Data Warehouse Connector feature for Matomo Cloud, giving you even more ways to work with your analytics data. 

  Until now, getting raw data from Matomo Cloud required APIs and custom scripts, or waiting for engineering help.  

  Our new Data Warehouse Connector feature removes those barriers. You can now access your raw, unaggregated data and schedule regular exports straight to your data warehouse. 

  The feature works with all major data warehouses including (but not limited to) : 

  • Google BigQuery 
  • Amazon Redshift 
  • Snowflake 
  • Azure Synapse Analytics 
  • Apache Hive 
  • Teradata 

  You can schedule exports, combine your Matomo data with other data sources in your data warehouse, and easily query data with SQL-like queries. 

  Direct raw data access for greater data portability 

  Waiting for engineering support can delay your work. Managing API connections and writing scripts can be time-consuming. This keeps you from focusing on what you do best—analysing data. 

  

  With the Data Warehouse Connector feature, you get direct access to your raw Matomo data without the technical setup. So, you can spend more time analysing data and finding insights that matter. 

  Bringing your data together 

  Answering business questions often requires data from multiple sources. A single customer interaction might span your CRM, web analytics, sales systems, and more. Piecing this data together manually is time-consuming—what starts as a seemingly simple question from stakeholders can turn into hours of work collecting and comparing data across different tools. 

  This feature lets you combine your Matomo data with data from other business systems in your data warehouse. Instead of switching between tools or manually comparing spreadsheets, you can analyse all your data in one place to better understand how customers interact with your business. 

  Easy, custom analysis with SQL-like queries 

  Standard, pre-built reports often don’t address the specific, detailed questions that analysts need to answer.  

  When you use the Data Warehouse Connector feature, you can use SQL-like queries in your data warehouse to do detailed, customised analysis. This flexibility allows you to explore your data in depth and uncover specific insights that aren’t possible with pre-built reports. 

  

  Here is an example of how you might use SQL-like query to compare the behaviours of paying vs. non-paying users : 

  				
                                          <xmp>SELECT  
  
  
  
  custom_dimension_value AS user_type, -- Assuming 'user_type' is stored in a custom dimension 
  
  
  
  COUNT(*) AS total_visits,  
  
  
  
  AVG(visit_total_time) AS avg_duration, 
  
  
  
  SUM(conversion.revenue) AS total_spent  
  
  
  
  FROM  
  
  
  
  `your_project.your_dataset.matomo_log_visit` AS visit 
  
  
  
  LEFT JOIN  
  
  
  
  `your_project.your_dataset.matomo_log_conversion` AS conversion  
  
  
  
  ON  
  
  
  
  visit.idvisit = conversion.idvisit  
  
  
  
  GROUP BY  
  
  
  
  custom_dimension_value; </xmp>
  
                                  
  			

  This query helps you compare metrics such as the number of visits, average session duration, and total amount spent between paying and non-paying users. It provides a full view of behavioural differences between these groups. 

  Advanced data manipulation and visualisation 

  When you need to create detailed reports or dive deep into data analysis, working within the constraints of a fixed user interface (UI) can limit your ability to draw insights. 

  Exporting your Matomo data to a data warehouse like BigQuery provides greater flexibility for in-depth manipulation and advanced visualisations, enabling you to uncover deeper insights and tailor your reports more effectively. 

  Getting started 

  To set up data warehouse exports in your Matomo : 

  1. Go to System Admin (cog icon in the top right corner) 
  2. Select ‘Export’ from the left-hand menu 
  3. Choose ‘Data Warehouse Connector’ 

  You’ll find detailed instructions in our data warehouse exports guide.  

  Please note, enabling this feature will cost an additional 10% of your current subscription. You can view the exact cost by following the steps above. 

  New to Matomo ? Start your 21-day free trial now (no credit card required), or request a demo. 

  Try Matomo for Free

  21 day free trial. No credit card required.

  
  

  Your email address
  

  Your website address
  

  Your Analytics subdomain will be .matomo.cloud (change)

  Choose your analytics subdomain
  

  .matomo.cloud

  I accept the terms and conditions and data processing agreement (DPA)

  
  Your information will be used to create an account on our cloud service. For more information please consult our privacy policy.
  
  
  

  Start improving your websites now

  

• Issues with processing media on windows Azure

  23 septembre 2015, par Ahmed Mujtaba

  I have a website built on ASP.NET web forms that works as a media portal for users to upload videos. I’m using ffmpeg encoders to produce video contents to be streamed in the browser. I’m using the web deploy method to publish the site on the Azure server. The website get’s deployed properly however I get following issues in the live site.

  1. Video never get’s encoded and published. I get some sort of error.

  2. Video get’s published but the process of uploading and encoding the video is way too slow on the web server.

  My project solution contains upload.ashx that handles the upload requests and makes the call to encode.ashx which is responsible for the encoding and publishing of the videos. I tried to remotely debug the site but the debugger never get’s to encode.ashx.

  I was wondering if these issues can be resolved by having the website deployed with a VM ?

  Script that uploads the video file :

   var filesuploaded = 0;
  
      var faileduploaded = 0;
  
  
  
      $(function () {
  
          var uploader = new plupload.Uploader({
  
              runtimes: 'gears,html5,flash,silverlight,browserplus',
  
              browse_button: '<%= pickfiles.ClientID %>',
  
              container: 'container',
  
              max_file_size: '<%= MaxMediaSize %>mb',
  
              url: '<%=Config.GetUrl() %>videos/upload/upload.ashx',
  
              flash_swf_url: '<%=Config.GetUrl() %>plupload/js/plupload.flash.swf',
  
              silverlight_xap_url: '<%=Config.GetUrl() %>plupload/js/plupload.silverlight.xap',
  
              chunk_size: '4mb',
  
              <%= UniqueNames %>
  
              filters: [
  
              { title: '<%= AllowedFormatsDisplay %>', extensions: '<%= AllowedFormats %>'}],
  
              headers: { UName: '<%=UserName %>', MTP: '<%= MediaType %>' }
  
          });
  
          //uploader.bind('Init', function (up, params) {
  
          //    $('#filelist').html("<div>Current runtime: " + params.runtime + "</div>");
  
          //});
  
  
  
          uploader.init();
  
  
  
          $('#uploadfiles').click(function (e) {
  
              uploader.start();
  
              e.preventDefault();
  
              $("#uploadfiles").hide();
  
              $("#&lt;%= embd.ClientID %>").hide();
  
          });
  
  
  
          uploader.bind('FilesAdded', function (up, files) {
  
              $("#uploadfiles").show();
  
              $("#&lt;%= msg.ClientID %>").html("");
  
              var count=0;
  
              $.each(files, function (i, file) {
  
                  $('#filelist').append(
  
                      '<div class="item_pad_4 bx_br_bt">' + (count + 1) + ': ' + file.name + ' (' + plupload.formatSize(file.size) + ')  <b></b></div>' );
  
                  count++;
  
              });
  
              var maxupload = &lt;%= MaxVideoUploads %>;
  
              if(count > maxupload) 
  
              {               
  
                  $.each(files, function(i, file) {
  
                      uploader.removeFile(file);
  
                  });
  
  
  
                  $('#filelist').html("");
  
                  $("#uploadfiles").hide();
  
                  Display_Message("#&lt;%= msg.ClientID %>", "Can't upload more than " + maxupload + " records at once!", 1, 1);
  
                  return false;
  
              }
  
              else {
  
                  $("#tfiles").html(count);
  
                  $("#uploadfiles").removeClass("disabled");
  
                  $("#&lt;%= pickfiles.ClientID %>").hide();
  
              }
  
              up.refresh(); // Reposition Flash/Silverlight
  
          });
  
  
  
          uploader.bind('UploadProgress', function (up, file) {
  
              $('#' + file.id + " b").html(file.percent + "%");
  
          });
  
  
  
          uploader.bind('Error', function (up, err) {
  
              $('#filelist').append("<div>Error: " + err.code +
  
                  ", Message: " + err.message +
  
                  (err.file ? ", File: " + err.file.name : "") +
  
                  "</div>"
  
              );
  
              up.refresh(); // Reposition Flash/Silverlight
  
          });
  
  
  
          var failedstatus = 0;
  
          uploader.bind('FileUploaded', function (up, file, info) {
  
              // encode started
  
              if (info.response != "failed" &amp;&amp; info.response != "") {
  
                  EncodeVD(file.id, info.response, file.size);
  
                  Display_Message('#' + file.id, "Please wait for final processing", 0, 1);
  
                  if (failedstatus == 0)
  
                      Redirect(info.response);
  
                  filesuploaded++;
  
              }
  
              else {
  
                  Display_Message('#' + file.id, "Response is: " + info.response, 0, 1);
  
              }
  
          });
  
      });
  
      var redcnt = 0;
  
      function Redirect(filename) {
  
          var IntervalID = setInterval(function () {
  
              redcnt++;
  
              if (redcnt > 2) {
  
                  clearInterval(IntervalID);
  
                  var tfiles = $("#tfiles").html();
  
                  if(tfiles == faileduploaded) { // break further processing all videos failed to upload
  
                  }
  
                  else if (filesuploaded >= tfiles) {
  
                      document.location = "&lt;%=ConfirmPageUrl %>?fn=" + filename + "&amp;gid=&lt;%=GalleryID %>&amp;uvids=" + $("#tfiles").html() + "&amp;mpid=" + $("#maxpid").html().trim() + "&lt;%=GroupParam %>";
  
                  }
  
          }
  
          }, 2000);
  
  }
  
  function EncodeVD(mid, mfile, msize) {
  
      var params = '&lt;%= EncodingParams %>&amp;fn=' + mfile;
  
          $.ajax({
  
              type: 'GET',
  
              url: '&lt;%= Encoding_Handler_Path %>',
  
              data: params,
  
              async: true,
  
              success: function (msg) {
  
                  if (msg == "Success" || msg == "") {
  
                      $('#' + mid).html('<strong>Uploading Completed Successfully - Wait for Processing.');
  
                  }
  
                  else {
  
                      failedstatus = 1;
  
                      faileduploaded++;
  
                      Display_Message('#' + mid, "Response is: " + msg, 0, 1);
  
                  }
  
              }
  
          });
  
      }
  
  </strong>

  Server side code for processing the file upload :

   private int MediaType = 0; // 0 : video, 1: audio
  
  
  
      public void ProcessRequest (HttpContext context) {
  
          try
  
          {
  
              context.Response.ContentType = "text/plain";
  
              context.Response.Write(ProcessMedia(context));
  
          }
  
          catch (Exception ex)
  
          {
  
              context.Response.Write("error|" + ex.Message);
  
          }
  
      }
  
  
  
      public string ProcessMedia(HttpContext context)
  
      {
  
          if (context.Request.Files.Count > 0)
  
          {
  
              int chunk = context.Request["chunk"] != null ? int.Parse(context.Request["chunk"]) : 0;
  
              string fileName = context.Request["name"] != null ? context.Request["name"] : string.Empty;
  
              //string _fileName = fileName.Remove(fileName.LastIndexOf(".")) + "-" + Guid.NewGuid().ToString().Substring(0, 6) + "" + fileName.Remove(0, fileName.LastIndexOf("."));
  
              HttpPostedFile fileUpload = context.Request.Files[0];
  
  
  
              string upath = "";
  
              if (context.Request.Headers["UName"] != null)
  
                  upath = context.Request.Headers["UName"].ToString();
  
  
  
              //if (CloudSettings.EnableCloudStorage && upath != "")
  
              //    _fileName = upath.Substring(0, 3) + "-" + _fileName; // avoid duplication in cloud storage
  
  
  
              if (context.Request.Headers["MTP"] != null)
  
                  MediaType = Convert.ToInt32(context.Request.Headers["MTP"]);
  
  
  
              //string extensions = "";
  
              //if (MediaType == 0)
  
              //    extensions = Site_Settings.Video_Allowed_Formats;
  
              //else
  
              //    extensions = Site_Settings.Audio_Allowed_Formats;
  
  
  
              //bool sts = UtilityBLL.Check_File_Extension(extensions, fileName.ToLower());
  
              //if (sts == false)
  
              //{
  
              //    return "Invalid format, please upload proper video!"; // Invalid video format, please upload proper video
  
              //}
  
  
  
              int allowable_size_mb = 0;
  
              if (MediaType == 0)
  
              {
  
                  allowable_size_mb = Site_Settings.Video_Max_Size;
  
              }
  
              else
  
              {
  
                  allowable_size_mb = Site_Settings.Audio_Max_Size;
  
              }
  
              int UploadSize = allowable_size_mb * 1000000;
  
              if (fileUpload.ContentLength > UploadSize)
  
              {
  
                  return "Video Limit Exceeds";
  
              }
  
  
  
              string uploadPath = "";
  
              // check whether audio / mp3 encoding enabled
  
              if (this.MediaType == 1)
  
              {
  
                  // audio encoding
  
                  if (fileName.EndsWith(".mp3"))
  
                  {
  
                      // upload mp3 directly in mp3 path instead of default path
  
                      if (upath == "")
  
                          uploadPath = UrlConfig.MP3_Path(); // source video path
  
                      else
  
                          uploadPath = UrlConfig.MP3_Path(upath); // source video path
  
                  }
  
                  else
  
                  {
  
                      // default path
  
                      if (upath == "")
  
                          uploadPath = UrlConfig.Source_Video_Path(); // source video path
  
                      else
  
                          uploadPath = UrlConfig.Source_Video_Path(upath); // source video path
  
                  }
  
              }
  
              else
  
              {//azure
  
                  // default path
  
                  if (upath == "")
  
                      uploadPath = UrlConfig.Source_Video_Path(); // source video path
  
                  else
  
                      uploadPath = UrlConfig.Source_Video_Path(upath); // source video path
  
              }
  
  
  
              FileStream fs;
  
              using (fs = new FileStream(Path.Combine(uploadPath, fileName), chunk == 0 ? FileMode.Create : FileMode.Append))
  
              {
  
                  byte[] buffer = new byte[fileUpload.InputStream.Length];
  
                  fileUpload.InputStream.Read(buffer, 0, buffer.Length);
  
  
  
                  fs.Write(buffer, 0, buffer.Length);
  
              }
  
              return fileName; // "Success";
  
          }
  
          else
  
          {
  
              return "failed";
  
          }
  
  
  
          return "";
  
      }
  
      public bool IsReusable {
  
          get {
  
              return false;
  
          }
  
      }

  code in encode.aspx responsible for encoding the video :

  private string EncodeMedia(HttpContext context)
  
  {
  
      string sourcepath = "";
  
      string publishedpath = "";
  
      string mp3path = "";
  
      string thumbpath = "";
  
      if (this.UserName != "")
  
      {//azure
  
          sourcepath = UrlConfig.Source_Video_Path(this.UserName);
  
          publishedpath = UrlConfig.Published_Video_Path(this.UserName);
  
          mp3path = UrlConfig.MP3_Path(this.UserName);
  
          thumbpath = UrlConfig.Thumbs_Path(this.UserName);
  
      }
  
      else
  
      {
  
          sourcepath = UrlConfig.Source_Video_Path();
  
          publishedpath = UrlConfig.Published_Video_Path();
  
          mp3path = UrlConfig.MP3_Path();
  
          thumbpath = UrlConfig.Thumbs_Path();
  
      }
  
      if (this.FileName.EndsWith(".mp3") && this.MediaType == 1)
  
      {
  
          // mp3 and audio format
  
          if (!File.Exists(mp3path + "/" + this.FileName))
  
          {
  
              return "Audio file not found!";
  
          }
  
      }
  
      else
  
      {
  
          // rest normal video and audio encoding
  
          if (!File.Exists(sourcepath + "/" + this.FileName))
  
          {
  
              return "Source file not found!";
  
          }
  
      }
  
  
  
      if (CloudSettings.EnableCloudStorage && this.UserName != "")
  
          this.FileName = this.UserName.Substring(0, 3) + "-" + this.FileName; // avoid duplication in cloud storage
  
  
  
  
  
      //double f_contentlength = 0;
  
      //if (Site_Settings.Feature_Packages == 1)
  
      //{
  
      //    if (Config.GetMembershipAccountUpgradeType() != 1)
  
      //    {
  
      //        // Check whether user have enough space to upload content
  
      //        // Restriction only for normal or premium users
  
      //        f_contentlength = (double)fileUpload.ContentLength / 1000000;
  
      //        string media_field_name = "space_video";
  
      //        if (MediaType == 1)
  
      //            media_field_name = "space_audio";
  
      //        if (!User_PackagesBLL.Check_User_Space_Status(upath, media_field_name, f_contentlength) && !isAdmin)
  
      //        {
  
      //            // insufficient credits to upload content
  
      //            return "Insufficient credits to upload media file"; //   Response.Redirect(Config.GetUrl("myaccount/packages.aspx?status=" + media_field_name), true);
  
      //        }
  
      //    }
  
      //}
  
  
  
      this.backgroundpublishing = true; // should be true on direct encoding
  
      // Video Processing
  
      string flv_filename = "";
  
      string original_filename = "";
  
      string thumb_filename = "";
  
      string duration = "";
  
      int duration_sec = 0;
  
  
  
      // set video actions : 1 -> on, 0 -> off
  
      int isenabled = 1;
  
      int ispublished = 1;
  
      int isreviewed = 1;
  
      int isresponse = 0;
  
      if (Response_VideoID > 0)
  
          isresponse = 1;
  
  
  
      string flv_url = "none";
  
      string thumb_url = "none";
  
      string org_url = "none";
  
      string _embed = "";
  
  
  
      string errorcode = "0";
  
      VideoInfo info = null;
  
  
  
      if (Site_Settings.Content_Approval == 0)
  
          isreviewed = 0;
  
  
  
  
  
      // check whether audio / mp3 encoding enabled
  
      if (this.FileName.EndsWith(".mp3") && this.MediaType==1)
  
      {
  
          // audio encoding
  
          // mp3 file already
  
          // so no encoding happens
  
          MediaHandler _minfo = new MediaHandler();
  
          _minfo.FFMPEGPath = Encoding_Settings.FFMPEGPATH;
  
          _minfo.FileName = FileName;
  
          _minfo.InputPath = mp3path;
  
          info = _minfo.Get_Info();
  
  
  
          flv_filename = FileName;
  
          original_filename = FileName;
  
          duration = info.Duration;
  
          duration_sec = info.Duration_Sec;
  
          isenabled = 1; // enabled
  
      }
  
      else if (this.directpublishing)
  
      {            
  
  
  
          // publish video
  
          ArrayList itags = new ArrayList();
  
          MHPEncoder encoder = new MHPEncoder();
  
          //if (this.FileName.EndsWith(".mpeg") || this.FileName.EndsWith(".mpg")) // use mpg compatible ffmpeg encoder
  
          //    encoder.FfmpegPath = HttpContext.Current.Server.MapPath(HttpContext.Current.Request.ApplicationPath) + "\\ffmpeg\\ffmpegbk\\ffmpeg.exe";
  
              //encoder.ThumbFfmpegPath = Encoding_Settings.FFMPEGPATH; // use normal ffmpeg encoder for thumbs processing
  
  
  
          //azure
  
          encoder.FfmpegPath = Encoding_Settings.FFMPEGPATH; // use normal ffmpeg encoder
  
          encoder.FlvToolPath = Encoding_Settings.FLVTOOLPATH; // set meta information for flv videos
  
          encoder.Mp4BoxPath = Encoding_Settings.MP4BoxPath; // set meta information for mp4 videos
  
          encoder.SourcePath = sourcepath;
  
          encoder.SourceFileName = this.FileName;
  
  
  
          // No cloud storage on direct encoding
  
          //if (CloudSettings.EnableCloudStorage)
  
          //    encoder.EnableCloudStorage = true;
  
  
  
  
  
          if (MediaType == 1)
  
          {
  
              // audio encoding
  
              itags.Add("14");
  
              encoder.iTags = itags;
  
              encoder.GrabThumbs = false;
  
              encoder.PublishedPath = mp3path;
  
  
  
              //_vprocess.OutputPath = this.MP3Path;
  
              //_vprocess.isAudio = true;
  
          }
  
          else
  
          {
  
              // video encoding
  
              itags.Add(EncoderSettings.DefaultITagValue.ToString()); // 5 for 360p mp4 encoding    
  
              //itags.Add(7);   // this will call 7 case settings to publish next video ending with _7.mp4 instead of _5.mp4
  
              // so there will be 2 videos with different resoultions published at the end of the process?
  
              // yesmake sure use proper settings first test it directly via command.     
  
              //okay i got it. But i'm gonna have to use a different media players to incroporate those settings
  
              // once published you can load different videos for different user by checking _7.mp4 (end) va
  
             //okay got it.
  
  
  
              //azure
  
              encoder.PublishedPath = publishedpath;
  
              encoder.iTags = itags;
  
              encoder.ThumbsDirectory = thumbpath;
  
              encoder.TotalThumbs = 15;
  
  
  
              //_vprocess.ThumbPath = this.ThumbPath;
  
              //_vprocess.OutputPath = this.FLVPath;
  
              //if (Config.isPostWaterMark())
  
              //{
  
              //    // script for posting watermark on video
  
              //    _vprocess.WaterMarkPath = Server.MapPath(Request.ApplicationPath) + "\\contents\\watermark";
  
              //    _vprocess.WaterMarkImage = "watermark.gif";
  
  
  
              //}
  
          }
  
          int deleteoption = Site_Settings.Video_Delete_Original;
  
          if (deleteoption == 1)
  
          {
  
              encoder.DeleteSource = true;
  
          }
  
          // background processing
  
          if (this.backgroundpublishing && this.MediaType==0)
  
          {
  
              encoder.BackgroundProcessing = true;
  
              // get information from source video in order to store it in database
  
              MediaHandler _minfo = new MediaHandler();
  
              //if (this.FileName.EndsWith(".mpeg") || this.FileName.EndsWith(".mpg")) // use mpg compatible ffmpeg encoder
  
              //    encoder.FfmpegPath = HttpContext.Current.Server.MapPath(HttpContext.Current.Request.ApplicationPath) + "\\ffmpeg\\ffmpegbk\\ffmpeg.exe";
  
              //else
  
                  _minfo.FFMPEGPath = Encoding_Settings.FFMPEGPATH;
  
  
  
              _minfo.FileName = FileName;
  
              _minfo.InputPath = sourcepath;
  
              info = _minfo.Get_Info();
  
          }
  
          // encode video processing
  
          Video_Information vinfo = encoder.Process();
  
          if (vinfo.ErrorCode > 0)
  
          {
  
              errorcode = vinfo.ErrorCode.ToString();
  
              ErrorLgBLL.Add_Log("Encoding Failed Log", "", "encoding error: " + vinfo.ErrorCode.ToString() + "<br />Description: " + vinfo.ErrorDescription.ToString());
  
               //return vinfo.ErrorDescription;
  
          }
  
          // Double check validation
  
          // if published video exist
  
          // if thumb exist
  
          // then proceed further
  
  
  
          if (MediaType == 0)
  
          {
  
              if (!File.Exists(encoder.PublishedPath + "/" + vinfo.FLVVideoName))
  
              {
  
                  return "Video failed to published properly.";
  
              }
  
              if (!File.Exists(encoder.ThumbsDirectory + "/" + vinfo.ThumbFileName))
  
              {
  
                  return "Thumbs failed to grab from video properly.";
  
              }
  
          }
  
          else
  
          {
  
              if (vinfo.FLVVideoName == "")
  
              {
  
                  vinfo.FLVVideoName = this.FileName.Remove(this.FileName.LastIndexOf(".")) + "_14.mp3"; // mp3 file path name
  
              }
  
              if (!File.Exists(encoder.PublishedPath + "/" + vinfo.FLVVideoName))
  
              {
  
                  return "Audio failed to published properly.";
  
              }
  
          }
  
          // Now thumbs and video published, procceed for data processing
  
          // get information from vinfo object
  
          if (this.backgroundpublishing &amp;&amp; this.MediaType == 0)
  
          {
  
              string OutputFileName = this.FileName.Remove(this.FileName.LastIndexOf("."));
  
              flv_filename = OutputFileName + "_" + EncoderSettings.DefaultITagValue + "." + EncoderSettings.Return_Output_Extension(EncoderSettings.DefaultITagValue);
  
              original_filename = vinfo.OriginalVideoName;
  
              thumb_filename = OutputFileName + "_008.jpg"; // info.ThumbFileName;
  
              duration = info.Duration;
  
              duration_sec = info.Duration_Sec;
  
          }
  
          else
  
          {
  
              flv_filename = vinfo.FLVVideoName;
  
              original_filename = vinfo.OriginalVideoName;
  
              thumb_filename = vinfo.ThumbFileName;
  
              duration = vinfo.Duration;
  
              duration_sec = vinfo.Duration_Sec;
  
              isenabled = vinfo.isEnabled;
  
          }
  
  
  
          // No cloud storage on direct encoding.
  
          // Note cloude storage only works if background processing is disabled
  
          // Or works in cased of sheduled processing
  
          if (CloudSettings.EnableCloudStorage &amp;&amp; errorcode == "0")
  
          {
  
              flv_url = "amazon";
  
              org_url = "https://s3.amazonaws.com/" + CloudSettings.OriginalVideoBucketName + "/" + this.FileName;
  
              thumb_url = "https://s3.amazonaws.com/" + CloudSettings.ThumbsBucketName + "/" + thumb_filename;
  
  
  
          }
  
  
  
      }
  
      else
  
      {
  
          // set publishing status off.
  
          ispublished = 0;
  
          original_filename = this.FileName;
  
      }
  
  
  
      // Store video information in database
  
      string ipaddress = context.Request.ServerVariables["REMOTE_ADDR"].ToString();
  
  
  
      // Store media information in database
  
      Video_Struct vd = new Video_Struct();
  
      vd.CategoryID = 0; // store categoryname or term instead of category id
  
      vd.Categories = Categories;
  
      vd.UserName = UserName;
  
      vd.Title = "";
  
      vd.Description = "";
  
      vd.Tags = Tags;
  
      vd.Duration = duration;
  
      vd.Duration_Sec = duration_sec;
  
      vd.OriginalVideoFileName = original_filename;
  
      vd.VideoFileName = flv_filename;
  
      vd.ThumbFileName = thumb_filename;
  
      vd.isPrivate = Privacy;
  
      vd.AuthKey = PAuth;
  
      vd.isEnabled = isenabled;
  
      vd.Response_VideoID = Response_VideoID; // video responses
  
      vd.isResponse = isresponse;
  
      vd.isPublished = ispublished;
  
      vd.isReviewed = isreviewed;
  
      vd.FLV_Url = flv_url;
  
      vd.Thumb_Url = thumb_url;
  
      vd.Org_Url = org_url;
  
      vd.Embed_Script = _embed;
  
      vd.isExternal = 0; // website own video, 1: embed video
  
      vd.IPAddress = ipaddress;
  
      vd.Type = MediaType;
  
      vd.YoutubeID = "";
  
      vd.isTagsreViewed = 1;
  
      vd.Mode = 0; // filter videos based on website sections
  
      //vd.ContentLength = f_contentlength;
  
      vd.GalleryID = GID;
  
      vd.ErrorCode = Convert.ToInt32(errorcode);
  
      long videoid = VideoBLL.Process_Info(vd, false);
  
  
  
      // Process tags
  
      if (Tags != "")
  
      {
  
          int tag_type = 0; // represent videos
  
          if (MediaType == 1)
  
              tag_type = 4; // represent audio file
  
          TagsBLL.Process_Tags(Tags, tag_type, 0);
  
      }
  
  
  
      if (Response_VideoID > 0)
  
      {
  
          VideoBLL.Update_Responses(Response_VideoID);
  
      }
  
  
  
      return "Success";
  
  }

• how to record camera to file while encoding stream to v4l2-loopback device ?

  3 février 2021, par Jonatas

  So i have this logitech c920 camera 1920x1080 h264 capable and i would like to record the camera to file while at the same time copying/encoding the stream to a loopback device so the camera can be still used by other apps.
here is the code i got so far :

  


  ffmpeg -report -f alsa -i hw:CARD=C920,DEV=0 -r 1500 -s 1920x1080 -f v4l2 -vcodec h264 \
-i /dev/video1 -copyinkf -vcodec copy /home/jonatas/Videos/2021-02-01185658.mp4 \ 
-f v4l2 /dev/video0


  


  error :

  


  Unknown V4L2 pixel format equivalent for yuvj420p
Could not write header for output file #1 (incorrect codec parameters ?): Invalid argument
Error initializing output stream 1:0 -- 


  


  some info on /dev/video0(loopbackdevice) :

  


  v4l2-ctl -d /dev/video0

    Device Caps      : 0x05208003
        Video Capture
        Video Output
        Video Memory-to-Memory
        Read/Write
        Streaming
        Extended Pix Format
Priority: 0
Video input : 0 (loopback: ok)
Video output: 0 (loopback in)
Format Video Output:
    Width/Height      : 1280/720
    Pixel Format      : 'YUYV' (YUYV 4:2:2)
    Field             : None
    Bytes per Line    : 2560
    Size Image        : 1843200
    Colorspace        : sRGB
    Transfer Function : Default (maps to sRGB)
    YCbCr/HSV Encoding: Default (maps to ITU-R 601)
    Quantization      : Default (maps to Limited Range)
    Flags             : 
Streaming Parameters Video Capture:
    Frames per second: 30.000 (30/1)
    Read buffers     : 8
Streaming Parameters Video Output:
    Frames per second: 30.000 (30/1)
    Write buffers    : 8

User Controls

                    keep_format 0x0098f900 (bool)   : default=0 value=0
              sustain_framerate 0x0098f901 (bool)   : default=0 value=0
                        timeout 0x0098f902 (int)    : min=0 max=100000 step=1 default=0 value=0
               timeout_image_io 0x0098f903 (bool)   : default=0 value=0


  


  some info on my camera in /dev/video1

  


  v4l2-ctl -d /dev/video1 --all
Driver Info:
    Driver name      : uvcvideo
    Card type        : HD Pro Webcam C920
    Bus info         : usb-0000:00:14.0-7.2
    Driver version   : 5.4.78
    Capabilities     : 0x84a00001
        Video Capture
        Metadata Capture
        Streaming
        Extended Pix Format
        Device Capabilities
    Device Caps      : 0x04200001
        Video Capture
        Streaming
        Extended Pix Format
Media Driver Info:
    Driver name      : uvcvideo
    Model            : HD Pro Webcam C920
    Serial           : EC6C336F
    Bus info         : usb-0000:00:14.0-7.2
    Media version    : 5.4.78
    Hardware revision: 0x00000011 (17)
    Driver version   : 5.4.78
Interface Info:
    ID               : 0x03000002
    Type             : V4L Video
Entity Info:
    ID               : 0x00000001 (1)
    Name             : HD Pro Webcam C920
    Function         : V4L2 I/O
    Flags         : default
    Pad 0x01000007   : 0: Sink
      Link 0x0200001f: from remote pad 0x100000a of entity 'Processing 3': Data, Enabled, Immutable
Priority: 2
Video input : 0 (Camera 1: ok)
Format Video Capture:
    Width/Height      : 1280/720
    Pixel Format      : 'H264' (H.264)
    Field             : None
    Bytes per Line    : 2560
    Size Image        : 1843200
    Colorspace        : sRGB
    Transfer Function : Default (maps to sRGB)
    YCbCr/HSV Encoding: Default (maps to ITU-R 601)
    Quantization      : Default (maps to Full Range)
    Flags             : 
Crop Capability Video Capture:
    Bounds      : Left 0, Top 0, Width 1280, Height 720
    Default     : Left 0, Top 0, Width 1280, Height 720
    Pixel Aspect: 1/1
Selection Video Capture: crop_default, Left 0, Top 0, Width 1280, Height 720, Flags: 
Selection Video Capture: crop_bounds, Left 0, Top 0, Width 1280, Height 720, Flags: 
Streaming Parameters Video Capture:
    Capabilities     : timeperframe
    Frames per second: 30.000 (30/1)
    Read buffers     : 0
                     brightness 0x00980900 (int)    : min=0 max=255 step=1 default=128 value=128
                       contrast 0x00980901 (int)    : min=0 max=255 step=1 default=128 value=128
                     saturation 0x00980902 (int)    : min=0 max=255 step=1 default=128 value=128
 white_balance_temperature_auto 0x0098090c (bool)   : default=1 value=1
                           gain 0x00980913 (int)    : min=0 max=255 step=1 default=0 value=255
           power_line_frequency 0x00980918 (menu)   : min=0 max=2 default=2 value=2
                0: Disabled
                1: 50 Hz
                2: 60 Hz
      white_balance_temperature 0x0098091a (int)    : min=2000 max=6500 step=1 default=4000 value=3233 flags=inactive
                      sharpness 0x0098091b (int)    : min=0 max=255 step=1 default=128 value=128
         backlight_compensation 0x0098091c (int)    : min=0 max=1 step=1 default=0 value=0
                  exposure_auto 0x009a0901 (menu)   : min=0 max=3 default=3 value=3
                1: Manual Mode
                3: Aperture Priority Mode
              exposure_absolute 0x009a0902 (int)    : min=3 max=2047 step=1 default=250 value=333 flags=inactive
         exposure_auto_priority 0x009a0903 (bool)   : default=0 value=0
                   pan_absolute 0x009a0908 (int)    : min=-36000 max=36000 step=3600 default=0 value=0
                  tilt_absolute 0x009a0909 (int)    : min=-36000 max=36000 step=3600 default=0 value=0
                 focus_absolute 0x009a090a (int)    : min=0 max=250 step=5 default=0 value=0
                     focus_auto 0x009a090c (bool)   : default=1 value=0
                  zoom_absolute 0x009a090d (int)    : min=100 max=500 step=1 default=100 value=100


  


  if i remove the 3rd line of my script the camera records the stream of video and sound to the file flawless. i tried diferent things for the 3rd line as -vcodec and something to do with pix-format flag to YUYV without success.
Is it possible to achieve this with just one ffmpeg process ?
Will the sound be made available to the loopback device also ?
How to transcode it to the proper pixel format used by loopback device ?