Last time, I told you a bit about my work looking into multichannel audio for BBC HD. I’m getting settled into this project now, and I’m starting to build a decent map of the Dolby E signal chain. I’ve met most of our technology partners and made contact with a few more. Here’s some of what I’ve found out so far…

It became clear pretty quickly that synchronisation is a big deal in the world of Dolby E. Really there’s 2 issues here:

  • Traditional signal synchronisation, whereby video and audio signals’ timing is adjusted to match a common reference, causes big problems in a Dolby E environment.
  • Like any coding system, the encoding and decoding of Dolby E has latency involved. Therefore matching the delays between video and audio paths becomes critical to ensuring accurate lip sync.

So right now that’s what I’m focussing on. Already I’ve discovered that we’ve got a number of gremlins in the system, but the folks at Red Bee and Siemens are working hard to make things better. In the mean time I’m getting under their feet asking for piles of information about their equipment setups, but hopefully also contributing in a helpful way too.

Those of you who watch BBC HD will shortly be seeing the fruits of my labours on air in fact. A short while ago I was discussing the signal chain in one of the many technical areas that our signal passes through, and I walked away with some schematics. I took them back to my desk and quickly found a problem… the processing delays in the audio chain weren’t being correctly compensated for in the video chain, meaning that all BBC HD output had its audio a frame behind the video. In other words, the lip sync was off by 40ms. This isn’t exactly what we want! I won’t name and shame, especially because the blame can’t necessarily be attributed to any individual or organisation, but suffice to say that it was more of a paperwork mess-up than a  technical one. It transpires that the technical area in question was working to an old version of our working practices, which specified a frame of offset was to be kept between audio and video until point of transmission. This means that you can whack the audio through a decoder (with 1 frame of delay) and get sound out of it that was in sync with the video. We now work in a different way however; audio and video should always be kept in sync, and the person decoding the audio has the responsibility to delay the video to match. This ought to be less confusing, but it seems it didn’t work out that way!

What made this issue even more tricky to spot previously was that in the early days of BBC HD (remember it started as a trial service on a shoestring budget and only recently became a fully-fledged BBC service) we had problems with video kit introducing unpredictable delays. In particular, equipment working flat out was producing delays which actually varied over time, making accurate measurement and compensation a nightmare. So with video delays being introduced and no real way to be sure of what they were, an extra 40ms delay in the audio chain (as I spotted) was not only difficult to notice, but may have actually been helping us until recently! Andy Quested (Head of technology for BBC HD) commented in a response to his own blog post. Now we’ve upgraded some of the kit, we’re starting to iron out these issues, and hence come across new ones like one I found here. Since it was found, Andy undertook some consultation with colleagues at BBC R&I in Kingswood Warren, and a change to correct this problem has now been agreed and will be on air very soon. Phew! [Update - it's been changed, so the sync should now be improved.]

Meanwhile in our playout centre, I’ve been running around with Red Bee’s engineers trying to understand the timing issues there. They’ve put in a great deal of effort to attempt to make sure everything is OK, and have done lots of good work.  Their synchronisers are mostly a model which performs a “Dolby E re-align” process before synchronising, which makes sure the Dolby audio data is in-sync with the video data before worrying about synchronising the whole lot with an external reference. This ensures that the audio doesn’t get mangled in the process, so there’s a big tick in that box. However they’ve had issues with what happens between programmes when switching sources (i.e. from programme to programme or to/from trailers). If you pay very close attention, you may notice quiet clicks on the audio or brief silences, usually around half a second after we transition from one video source to another. We’re working through these issues together with some input from Dolby, and I’m hoping to get to the bottom of things soon, at which point I’ll explain more.

Beyond simply problem-solving, my task here is really to help prevent future problems and collate some understanding about the use of multichannel audio technologies in order to improve our operations in future. In Red Bee, the lip sync seems to be pretty much spot on after extensive testing that they’ve done. However what’s happened is that they’ve done some tests on how delayed the audio gets compared with the video and then delayed the video to compensate. This works just fine, but it makes part of me a little nervous. It’s here that you’ll see the difference in approach between myself and the playout engineers; they have a service to keep on air and they want it to look and sound as good as possible. They do that well, but my priority is different; where they want to know that things to work, I want to know why they work. (Actually, they want that too, it’s just priority number 2 for them and priority number 1 for me!) I want a diagram with all the bits of equipment and their associated delays, and I want it to add up! I’m in the process of drawing that diagram, but as yet I can’t quite make it add up. I’m catching up with my colleagues there tomorrow to do some arithmetic, and you never know, we might get somewhere.

Of course there’s lots I haven’t told you here, but I don’t want to bore you. More detail will come soon, as well as some information on the other questions I’m trying to answer, such as “just what do you do when you want to put Dolby E into a file-based workflow?”.  Feel free to comment below.


I’m an engineer with the BBC and sharing information about my work, but this is my personal website. Because the subject matter here is fairly different to my personal posts, this post is part of a seperate category, with its own RSS feed. You can therefore choose to only read my work-related posts, or to ignore them altogether.

8 Responses to “Down The Sync?”
  1. Mark Simpson says:

    Hi Rowan, Martin passed on the link to your blog. I’m looking forward to seeing/hearing the improvements you’re going to make as it has been a rather messy few months as far as the BBC HD lip sync is concerned! When I bought my Humax Foxsat it took me weeks to convince some nice people there where the fault lay, then a few weeks ago found it was a mile out again. I am fussy mind you, an audio delay I reported to our engineers in Belfast was measured as 6ms…

    As to those pesky playout people (!) at least there is plenty of time on the channel where you can play about to trace faults where there’s no programming on air. If you could convince them of the usefulness of a test card incorporating a lip-sync test, that’d be good! 8o)

    Mark.

  2. Hi Mark. Well if you can notice a 6ms sync error then you certainly have a sharper ear than I! However one of the things I’m going to be looking into is a line-up and sync test that can be run and provide us all the testing checks we need as we’re unhappy with any current solution. We’ll see how it goes…

  3. Q “What do you do when you want to put Dolby E into a file-based workflow?”
    A Think carefully about why you would want to do that….. and then don’t do it! – Go linear, Dolby E exists because you only get 4 audio tracks on an HDcam machine and because some contribution links have limited bandwidth. In a file based world there is very little need for it – it complicates things. With HDSDI you get 32 tracks of audio and that is where we need to put the surround mix. The real question is how do you transport the metadata for the emission coder….

    Did you talk to Andrew M about the sync stuff he’s doing?

  4. Trevor Harris says:

    Hi Rowan Thanks for a very interesting blog. One major problem for me is setting audio delay exactly. The time delays from my Onkyo Amplifier can be calibated automatically with a microphone. The time delay from my Sky box can be adjusted in 20ms intervals. I use the Sky testcard which is transmitted from time to time on Sky Arts but I find it very difficult to judge when sync is achieved. So I need some simple device to measure the time delay.

  5. Hi Trevor

    Tell me about it – getting your delays exactly right is a big problem. I take it you’re using an LCD display? (This will introduce a video delay because of its own processing.) I’m not aware of any simple consumer device (i.e. anything that doesn’t cost thousands) for doing this type of test, but then to be honest, I’ve never looked… If I hear of anything, I’ll let you know.

    Thanks for reading! Rowan

  6. Rowan,

    We make Valid in both HD & SD for video/audio line up, and you’ve doubtless seen lots of our other kit around. I work in development for our Vistek line, and would be happy to help in any way I can. We are active in Dolby E embedding, and keep finding all sorts of issues…

    Best Regards,

    Simon

  7. Hi Simon

    Thanks for the message. I’ve certainly come across plenty of your kit, and I’ve come across Valid/Valid8… One of my jobs will be to look at test/lineup/sync requirements, so I’ll certainly be finding out more. I’ll get in touch when I’m back at work (having day off today!), it’d be great to chat to you.

    Rowan

  8. Olly

    Sorry for only just replying – your message got flagged as spam… Yes, metadata for emission coding is exactly what I’m talking about – how to integrate Dolby E into a file-based workflow in the sense of Dolby E coming in (from a contribution link or whatever), transferring it into a file system but keeping the metadata in tact for re-use later. Yes, you almost certainly want to work in linear, but keeping the metadata is important – that’s what I’m talking about really. Currently in PQ for example, they have to manually read the metadata settings off the decoder, store them in a database and re-enter them by hand onto the output audio! And like it or not, Dolby E coming in is a fact of life for now, so we need a better solution… (And yeah, I’m talking to Andrew, thanks though)

    R

Leave a Reply

© 2008 Rowan de Pomerai | Admin