CODEWITHSUNDEEP
javascriptpythondjangowebrtcdjango-channels
Sashaank
Sashaank

Reputation: 964

Sending webRTC video stream to server with django channels

I am trying to create a face detection web application written in django. The app works this way.

  1. The user navigates to the url
  2. The camera starts on the client machine
  3. Each frame is then sent to the server for face detection
  4. Processed frame is then displayed on the web page

I understood I could not use opencv VideoCapture because, it only works on the server side. When I read online people asked me to use javascript and specifically webRTC to start live stream on the client side. So I found this tutorial which explains how to start webcam on the client machine with javascript.

Now my question is how to send each frame from javascript on the client machine to opencv python on the server side?

All this should happen in real time. So I cannot save the live video and then run the python code on the saved video.

Some sites asked me to use AJAX to send data to the server side but I am not sure how to target each frame that is to be sent in the javascript code.

This is my code so far

CLIENT SIDE CAMERA ACCESS WITH webRTC

<!DOCTYPE html>
<html>

<head>
  <meta charset="utf-8">
  <meta content="stuff, to, help, search, engines, not" name="keywords">
  <meta content="What this page is about." name="description">
  <meta content="Display Webcam Stream" name="title">
  <title>Display Webcam Stream</title>

  <style>
    #container {
      margin: 0px auto;
      width: 500px;
      height: 375px;
      border: 10px #333 solid;
    }

    #videoElement {
      width: 500px;
      height: 375px;
      background-color: #666;
    }
  </style>
</head>

<body>
  <div id="container">
    <video autoplay="true" id="videoElement">

    </video>
  </div>
  <script>
    var video = document.querySelector("#videoElement");

    if (navigator.mediaDevices.getUserMedia) {
      navigator.mediaDevices.getUserMedia({
          video: true
        })
        .then(function(stream) {
          video.srcObject = stream;
          // myJson = JSON.stringify(stream)
        })
        .catch(function(err0r) {
          console.log("Something went wrong!");
        });
    }

    console.log(video)
  </script>
</body>

</html>

In this piece of code how do I access each frame from the webcam. I tried to print the contents of video with console.log but that did not help.

DJANGO views.py

def index(request):
    return render(request, 'cwrtc/index.html', {})

I am using django channels because I figured, to send and receive data from the client side I might have to use web sockets. And I am using python because I plan to add more functionality to the application that will be easier to code with python than any other language.

Is it possible to send video stream from javascript to python?

Thanks in advance

Upvotes: 7

Views: 13942

Answers (2)

Arun
Arun

Reputation: 4214

I don't think this is a good approach for streaming a video via server. Why even you want to send video frames to server when webrtc directly offers p2p connection.All you need a socket library to manage the user and connect them.You can pass random generated roo_id to django channel for creating rooms.I will suggest you if you are good at nodejs go for socket.io library as very less resources and documentation available on django channel with webrtc.

Upvotes: 0

mesibo
mesibo

Reputation: 4348

yes, you can send video from javascript to python on your server, however, You can not use Ajax or web socket to send frames.

This is how you can do it.

  1. Create WebRTC session at client-end using javascript
  2. Run webrtc at your server-end using native code.
  3. Now create p2p session between client and server by exchanging SDPs. Note that you will need video capture device at server end else there won't be video session. If not, you can use fake video capturer at server end.
  4. You can then interface your python code with webrtc instance running on your server.

Let me know if you need more help.

Upvotes: 5

Related Questions