Image for hardware acceleration in Browser / Video update / timeframe?



  • I spent a few hours trying to get hw accel working:
    Installed correctly.
    gstreamer with ubuntu 16.04 is 1.8 and this requires 1.12 or greater so it was a bust. I tried compiling gstreamer from source but wasn't able to figure out how to install it without breaking all the packages already installed. I think the best solution is to just wait for a 18.04 distro to be released. From what I can tell, this will allow for the elusive hardware acceleration. Seems pretty achievable - ie already done.

  • edited June 5

    Yea. This is basically what I found too but firefly will have a huge task getting ubuntu 18.04 to work. They modified xorg to include HW acceleration. There is a huge reason why no one should do this. If the underlying code changes, integrating changes from a project as complex as xorg can be quite a challenge.

    I actually managed to get GStreamer 1.14 building but it didn't help. The libdrm and the libmali drivers didn't work properly for this board. I think you are right about the rpi 4. GStreamer is a very complicated application and they actually recommend not building it from scratch as it is too difficult for most people. You might be able to get it to build but it took me a few hours and I still missed dependencies. It really requires a dedicated build box, possibly only for building GStreamer, like in a VM.

    What I would really hope is that firefly can get a default xorg working, link up their drm and mali drivers, submit them to the upstream kernel team, and shove all graphics onto the hardware.

    It also looks like that firefly put out a newer chip faster than they could come up with the software to make it work, which is a shame. I understand the desire to put out something incredible before other people but they hurt themselves by not having video work. I also think they made a huge mistake selling this as having native 4k support or even 1080p while obviously not. The fact that a developer got a stream to work using h265 for a test stream in a demo does not mean VLC or GStreamer will playback video. If firefly was very smart, they would drop GStreamer and focus on porting omxplayer to make the transition easier from a raspberry pi.

    As I offered before, if firefly would like help getting the drm and mali stuff working, please create a git readme and a set of bug fixes and a set of tasks, put it up online, and allow the community to hack on it for a while. I am more than happy to help develop for this board but I would need a place to start.

  • @bholland firefly posted this a few days ago, The kernel code of Firefly ROC-RK3328-CC has been officially approved by The related BSP support has been added to Linux Kernel 4.17 version.
    You can download the code directly from the official website, use the configuration of Linux kernel to compile ROC-RK3328-CC, to get the native Linux operating system.
    i'm not a dev so don't know if this is a step forward, firefly posted another 16.04 build
    that's hard to download and doesn't boot I wish they would post what changes are when they post new builds,

  • edited June 5

    @bholland Most of the work can only be done by Rockchip. Linux video pipeline is incredibly immature for ARM based systems. It doesn't even work reliably on x86 systems and is usually masked by good CPU software decoders. There's multiple competing APIs and browsers like Chromium and Firefox don't bother to support hardware video acceleration on Linux due to the lack of clarity. You have V4L2 M2M, VAAPI, VDPAU, and numerous proprietary APIs for specific chips. It not as straight forward and easy.

  • Haha thank you loverpi. I've known this for awhile but it's refreshing to remind Linux noobs of this. Look guys, it's open source software that is built but volunteers mostly. So it's vital for people to roll up their sleeves and help code and stop bitching so much about what does or doesn't work perfectly for them. If you can't help then just deal with it, it's free software after all. It's not like you had to buy a copy like windows.

  • edited June 6

    And I work mostly with BSD on my other machines and in the BSD world, when something doesn't work the way you want it, you get some smarts and fix it yourself. Half these guys probably can't figure out the command line or how to use a terminal. Oh and btw i got the 4/04 ubuntu image working perfectly fine with tear-free video, smooth graphics, music and some* video games. So you all suck at computing.

  • edited June 6

    Hey Freedman, some of us don't code and can still use the command line.
    Not everyone is a programmer and can't contribute in that way.
    If you have a working image, why not share it with the rest of us noobs instead of being kind of a d#@k about it.
    Just because we buy a computer offered to work with advertised specs and it doesn't perform doesn't mean we can't or shouldn't complain. Sure the OS is free but it's not doing as advertized and we all understand we need to wait for someone smarter than most of us who understands how the hardware works and can code to do the work.
    I personally check here almost every day for the hope someone figured it out and can give step by step instructions, maybe with explinations so we can all "get smarter" on how things work and why you use certain command lines (What they do)
    To ask someone with no programming ability to just go get smarts and just "work it out" is counter productive and frankly, unreasonable.
    It would take many years of study to gain these skills from scratch, especially on your own with a handful of unhelpful people telling you you're a noob and too stupid.

    How about helping the community out if you're so smart. I'm sure loverpi and the other FireFly members would appreciate the help so they don't have to work it out and can just release the image.
    What a crap thing to say. Seriously, lift your game.

  • edited June 7

    Oh no, I used the regular image, I just know how to fine-tune linux to do whatever I want it to. Did you even look under the hood to see what you could do? When was the last time you even read a man page? Have you gone on the Ubuntu wiki, Debian wiki or Arch wiki and read any articles or guides for lightweight window manager/speed/optimization/power consumption? Did you know it works much better if you plug it into a regular computer monitor and not a flatscreen TV because the high resolution is heavier on the CPU/GPU? I did share some basic things in my retro-gamers post. But it sounds like I stuck a nerve with you so if the shoe fits wear it ;-) My game is lifted, my board works and yours apparently doesn't. Don't blame the machine it's the user. And yes, it does take time to learn, but isn't that why we bought SOC boards w/ a next gen chip in the first place? I'm confused about your stance here. I sure Best Buy has plenty of HP laptops with Windows 10 that would be better suited for you.

  • edited June 7

    That's what I thought.
    You're all talk and actually have nothing useful at all to actually offer the community.
    That wasn't a hard guess though, honestly ;-)
    It looks as though someone didn't read themselves, did they.
    The topic, is about hardware acceleration for video playback in browsers and media players.
    The video hardware is not properly implemented yet for assisted decodes, only you seem to be able to get it going it seems. This topic has everything to do with high resoulution and 4k decodes.

    Your game is far, far from lifted because, you're just not a very good human yet.
    Go work on your people skills.

  • edited June 7

    Uh, that is strange because video decoding does work, it's just an code immature sub-system like the dev said. But my point was that you can help code to fix the DRM stack and/or you can improve performance including video performance based on your system administration and tuning. This is why we use Linux or BSD in the first place, the near infinite tuning options in our software that doesn't exist in non-free OS's like Android, Windows or OSX. My wife says I need to be nicer to people, so I'll put it on my list to post a guide on how to fine-tune the lastest image (probably the debian 5/28) into a speed machine that's basically as fast as a laptop, for the most part (I know the current state of rockchip linux is imperfect and incomplete and I'm totally aware of that). It will be a suckless tools setup too, it's perfect for that board.

  • Your wife sounds like a very smart woman.
    This is exactly why Linus states why Linux has failed to break into the mainstream.
    People do it for themselves, get it half working and no one benifits except them.
    Some of us are not programmers.
    We don't have the hardware specs and years to train our minds on understanding the code required.
    We come to forums for help and instruction to learn and fix our issues, then we meet someone like you and that's why these computers never take off and its "off to best buy."
    Ok, that's a bit harsh, but it sure puts a bump in the road of learning.
    I appolgise somewhat however, all you did was jump in and belittle eveyone here in the most inconstructive way, calling them stupid, work it out for yourself, read a man page and you'll get it working, I mean really? you think the people who designed this computer didn't do that themselves with more knowlege than most of us?
    As you said, there are substantial improvments to be made in the code subsystem/api to get the GPU working properly. If you're so damm good, teach us!

    Offer guides, show us how to do the things to get the computer out and away from windows 10 and best buy.
    Contribute to humnanity and Linux in general.
    A man page a day is not going to make this issue go away.
    You sound as though you could contribute so, contribute!
    FireFly sure could use the help and after your last letter, maybe there is hope for someone like youreself as a person too. Even becoming a really useful mentor to people and who knows, making the entire race smarter in at least this instance.

  • edited June 8

    Okay okay, you've warmed my cold heart. I'm sorry, at first I was only teasing and that guy took it so personally that I turned up the heat on him unnecessarily. You are all right, I do have shitty social skills (that's why I love computers). And I'm a line cook, in a industry of assholes, so I come off as one too easily. Once again I apologize, the last thing I would ever want to do is take away from or disparage this community, give me a month and I'll post some guides (sorry busy schedule and I want to make sure I give you guys some quality stuff). My wife wants me to do a youtube channel where I teach people how to build lightweight linux/bsd systems and make them highly functional. The only problem is when people make mistakes based on information from me (i give guidelines but I'm no replacement for official docs) and they go to complain to to devs or forums, usually the hatred will be thrown back at me cause I making users lazy by giving them a cheap alternative to actually doing their homework and reading the documentation. Post a problem and say I followed xyz in freedman's youtube video and watch fire and pitchforks rise. You be surprised by some of the BSD/Arch Linux forums, those old unix-beards are grumps and they very little patience for noobs. So I have to find a balance to make it please both sides somehow.

  • That begs another question if the ROC-3328-CC can handle ffmpeg screencasting without the video being too choppy, I could do live videos from the device.

  • Well, far out. Your job sounds horrible.
    Maybe you could make money doing your Youtube guides idea and get out of that line cook stuff.
    That's not what humanity should be about. That area obviously needs severe improvment by a lot of us (humanity).
    I'm really, really glad I warmed your heart. The world is shit enough (as you have clearly illustrated)
    Less noob, more Linux. I'm looking forward to that. No more Windows, no more best buy.
    Yep, i'm good with that.

  • The latest images with LXDE and Android both have hardware accelerated video and 3D working properly. However, it doesn't work on all apps since most apps don't support gstreamer directly.

  • Unfortunately I had to jump ship for a platform that would do the job I needed. The rock64 board has hardware decoding working and can stream 1080p flawlessly. I don't have any 4k screens to test it with, but I'm told it works fine. I think part of the problem here is the old linux images, but I haven't built a linux kernel in over 20 years, so I'm of no use.

  • edited June 8

    Fantastic news. I will have a look. Is this the Armbian image? Android is not going to work for me, it's too unfriendly and locked down. I need Ubuntu Linux for daily use.
    *edit nevermind, i'll download and try out whatever is there.

    Freedman, send us your YouTube link (When you are ready) I'll subscribe for sure.
    I obviously have a lot of Linux to learn. ;-)

  • edited June 12

    I installed the new ROC-RK3328-CC-ubuntu18.04-LXDE_20180605
    It is installed and working however, the included Chrome browser acceleration seems stuck in low-resolution and CPU at 100% on all 4 cores running 720 or above. I am yet to try firefox as it's not yet installed so I guess, not gstreamer compatible?

    I guess i'll have to wait for ffmpeg to be added to compatibility. This is what I have seen on Google posts about Chrome thus far.

    My next step is to move over to BTRFS from ext4 as everything I am reading, it causes less wear on flash drives than the journaling versions like ext4 and it also uses crc checking on files which would be good to track any corruption.
    I'm still noobish so, we will see how far I get.

  • @loverpi
    What player uses gstreamer?
    I am trying 4k content and 1080p video from sampler sites in VLC and clearly, that doesn't support it.
    I then tried Videos/Totem and Parole (Which are based on gstreamer according to the software packager and google) and these also failed to playback fluently.

    Is there something I am missing?

  • edited June 18

    I don't suppose there is a recommended desktop manager for
    Armbian_5.46_Roc-rk3328-cc_Ubuntu_xenial_defaul..> 31-May-2018 02:53 is there?
    The page is down. Actually, all the image links are down.

Sign In or Register to comment.