[Live-devel] RTP header extension

[Jeff Shanab]

The containers using RTSP already define stream types for meta data beyond Video and Audio. Often used for analytics data for security camera video for example.  Is this what we are talking about?
________________________________
From: live-devel-bounces at ns.live555.com [live-devel-bounces at ns.live555.com] on behalf of Ross Finlayson [finlayson at live555.com]
Sent: Wednesday, January 16, 2013 9:04 AM
To: LIVE555 Streaming Media - development & use
Subject: Re: [Live-devel] RTP header extension

I guess this could be interesting to carry information inside the stream independandly of codec used.

That might be "interesting", but not necessarily appropriate.  It depends on what sort of 'information' this is.  The use of a RTP header extension is appropriate ***only if*** the information is directly related to the RTP packets (not just the stream as a whole).  For example, one can imagine some RTP packets carrying an extra timestamp (e.g., a 'decoding timestamp'), in addition to the usual RTP timestamp (from which a 'presentation timestamp' is derived).

If the 'information' is static, and unchanging, then it could be put in the stream's SDP description (e.g., the 'info' or 'description' SDP lines).  There are (optional) parameters to "ServerMediaSession::createNew()" to provide this information, and also - at the receiving end - member functions of "MediaSession" to get this information:
sessionName();
sessionDescription();

Another way to get information that's static (or doesn't change much) is to use the RTSP "GET_PARAMETER" command, as you've done.

For information that is time-based - i.e., changes over time - but is not directly related to an existing media stream (i.e., the audio or video stream) - then  the information could itself be its own RTP media stream - e.g., using the "text" media type.  Note, for example, that we support time-varying T.140 text streams over RTP, using the class "T140TextRTPSink".  (That's used for transmitting text over RTP; for receiving such streams, we just use "SimpleRTPSource".) We use such streams to transmit the 'subtitle' tracks from Matroska files (and VLC, when used as a RTP receiver, will also display these as subtitles).


Ross Finlayson
Live Networks, Inc.
http://www.live555.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.live555.com/pipermail/live-devel/attachments/20130118/d8ac4b6b/attachment.html>