CODEWITHSUNDEEP
flutterandroid-camera
Ertuğrul Karababa
Ertuğrul Karababa

Reputation: 31

Can i make stream with flutter camera package?

My purpose is stream to a websocket.

Firstly i need the camera data. I used startImageStream func for that. This func return image as yuv format. I found something about yuv to image widget but i couldnt convert it to base 64.

The question is how can i convert this yuv image data to base64 ? Or this is bad way to make a stream with flutter.

Upvotes: 1

Views: 2252

Answers (2)

Ertuğrul Karababa
Ertuğrul Karababa

Reputation: 31

I solved it. Here is the answer i found a convert func on internet here is :

imglib.Image img;


      if (Platform.isAndroid) {
        // Allocate memory for the 3 planes of the image
        Pointer<Uint8> p =
            allocate(count: _savedImage.planes[0].bytes.length);
        Pointer<Uint8> p1 =
            allocate(count: _savedImage.planes[1].bytes.length);
        Pointer<Uint8> p2 =
            allocate(count: _savedImage.planes[2].bytes.length);

        // Assign the planes data to the pointers of the image
        Uint8List pointerList =
            p.asTypedList(_savedImage.planes[0].bytes.length);
        Uint8List pointerList1 =
            p1.asTypedList(_savedImage.planes[1].bytes.length);
        Uint8List pointerList2 =
            p2.asTypedList(_savedImage.planes[2].bytes.length);
        pointerList.setRange(0, _savedImage.planes[0].bytes.length,
            _savedImage.planes[0].bytes);
        pointerList1.setRange(0, _savedImage.planes[1].bytes.length,
            _savedImage.planes[1].bytes);
        pointerList2.setRange(0, _savedImage.planes[2].bytes.length,
            _savedImage.planes[2].bytes);

        // Call the convertImage function and convert the YUV to RGB
        Pointer<Uint32> imgP = conv(
            p,
            p1,
            p2,
            _savedImage.planes[1].bytesPerRow,
            _savedImage.planes[1].bytesPerPixel,
            _savedImage.planes[0].bytesPerRow,
            _savedImage.height);

        // Get the pointer of the data returned from the function to a List
        List imgData = imgP.asTypedList(
            (_savedImage.planes[0].bytesPerRow * _savedImage.height));
        // Generate image from the converted data
        img = imglib.Image.fromBytes(_savedImage.height, _savedImage.planes[0].bytesPerRow, imgData);

        // Free the memory space allocated
        // from the planes and the converted data
        free(p);
        free(p1);
        free(p2);
        free(imgP);
      }
      else if (Platform.isIOS) {
        img = imglib.Image.fromBytes(
          _savedImage.planes[0].bytesPerRow,
          _savedImage.height,
          _savedImage.planes[0].bytes,
          format: imglib.Format.bgra,
        );
      }

After this code gives you a imglib.Image object and then i converted this image to jpg with that func :

      List<int> a = imglib.encodeJpg(img, quality: 100);
      var resp = await sendImage(base64.encode(a));
      print(resp.body);

I sent it to an api to see image and it worked..

Without encode i couldnt convert to base64 so the point is the :

List a = imglib.encodeJpg(img, quality: 100);

Upvotes: 0

eeqk
eeqk

Reputation: 3862

controller.startImageStream((image) {
  // convert image here

  // assuming it's converted
  final imageBytes = <int>[];

  final encodedImage = base64.encode(imageBytes);
});

as for yuv->rgb conversion, you can do something like this (code copied from https://gist.github.com/Alby-o/fe87e35bc21d534c8220aed7df028e03):

// imgLib -> Image package from https://pub.dartlang.org/packages/image
import 'package:image/image.dart' as imglib;
import 'package:camera/camera.dart';

Future<List<int>> convertImagetoPng(CameraImage image) async {
  try {
    imglib.Image img;
    if (image.format.group == ImageFormatGroup.yuv420) {
      img = _convertYUV420(image);
    } else if (image.format.group == ImageFormatGroup.bgra8888) {
      img = _convertBGRA8888(image);
    }

    imglib.PngEncoder pngEncoder = new imglib.PngEncoder();

    // Convert to png
    List<int> png = pngEncoder.encodeImage(img);
    return png;
  } catch (e) {
    print(">>>>>>>>>>>> ERROR:" + e.toString());
  }
  return null;
}

// CameraImage BGRA8888 -> PNG
// Color
imglib.Image _convertBGRA8888(CameraImage image) {
  return imglib.Image.fromBytes(
    image.width,
    image.height,
    image.planes[0].bytes,
    format: imglib.Format.bgra,
  );
}

// CameraImage YUV420_888 -> PNG -> Image (compresion:0, filter: none)
// Black
imglib.Image _convertYUV420(CameraImage image) {
  var img = imglib.Image(image.width, image.height); // Create Image buffer

  Plane plane = image.planes[0];
  const int shift = (0xFF << 24);

  // Fill image buffer with plane[0] from YUV420_888
  for (int x = 0; x < image.width; x++) {
    for (int planeOffset = 0;
        planeOffset < image.height * image.width;
        planeOffset += image.width) {
      final pixelColor = plane.bytes[planeOffset + x];
      // color: 0x FF  FF  FF  FF
      //           A   B   G   R
      // Calculate pixel color
      var newVal = shift | (pixelColor << 16) | (pixelColor << 8) | pixelColor;

      img.data[planeOffset + x] = newVal;
    }
  }

  return img;
}

Some background:

In the latter you can find a comment that links to what appears to be more efficient implementation, it's in YUV_2_RGB project: https://github.com/alexcohn/YUV_2_RGB/blob/master/lib/service/image_result_processor_service.dart

Upvotes: 3

Related Questions