CIFF TECHNOLOGY CORPORATION CIFF CODEC FOR THE IMPROVED BATTLESPACE INFORMATION DISSEMINATION USING ALREADY DEPLOYED ASSETS ENABLING TECHNOLOGY FOR NETWORK CENTRIC WARFARE CIFF TECHNOLOGY CORPORATION
3. CIFF CODEC MAJOR FEATURES Unified Lossy and Lossless Still Image, Video I-frame and IP-frame Symmetrical Encoding / Decoding Ultralow Codec Latency All 3 Video Scalabilities Highest Error Resilience Integer Arithmetic No Multiplication & Division 4:4:4, 4:2:2, 4:2:0, 4:0:0 YUV & RGB
4. CIFF CAPTURE
5. CIFF CAPTURE PREPROCESSING (DENOISING)
6. CIFF CAPTURE PREPROCESSING
7. CIFF PLAYER
8. CIFF PLAYER POSTPROCESSING
9. CIFF PLAYER POSTPROCESSING
10. HIGH RESOLUTION BENEFITS Future proof – available today Better situation awareness More reliable machine analysis Simpler decision making Accurate targeting IED activities spotting Collateral damage minimization Better evidence in disputed case Decrease political burden
11. ULTRALOW LATENCY BENEFITS Milliseconds latency Faster information delivery Faster decision making Faster time-sensitive targeting Faster C4ISR Faster UAS operator response Enabling air-refueling of UAV EO, IR & Hyperspectral synchronization Saving lives
12. BEST QUALITY
13. I-FRAME CIFF VS. I-FRAME OTHER “WEDDING” 1920x1080 25fps 4:2:0 Average PSNR [dB] CIFF-=CIFF WITH REDUCED LEVEL OF DETAILS. CR=COMPRESSION RATIO
14. I-CIFF VERSUS INTERFRAME (IPB) “WEDDING” 1920x1080 25fps 4:2:0 Average PSNR [dB] CIFF-=CIFF WITH REDUCED LEVEL OF DETAILS. CR=COMPRESSION RATIO
15. I-FRAME CIFF VS. IP-FRAME CIFF VIDEO SEQUENCE I-FRAME CIFF IP-FRAME CIFF IP RATIO I RATIO RATIO PSNR[dB] Parklot 47.77 34.87 369.48 34.98 7.73 Show 33.58 33.33 169.91 33.32 5.06 Lobby 24.51 31.62 114.91 31.71 4.69 akiyo 36.14 34.36 164.52 34.33 4.55 AFP1 42.09 33.54 191.57 33.49 Hallway 64.78 36.34 263.43 36.08 4.07 Stairs 42.16 34.27 171.40 34.13 Dark 102.05 37.98 400.00 37.59 3.92 door 31.06 32.60 93.66 32.00 3.02 Zodiac (HD) 54.46 34.21 162.64 34.05 2.99 Passing 53.18 35.18 145.92 34.92 2.74 AFP2 69.24 36.26 165.30 36.03 2.39 Blue 70.27 36.29 160.13 35.51 2.28 Catalina1 76.74 36.44 130.11 35.88 1.70 IR 56.80 32.62 84.97 32.47 1.50 AFP3 46.42 33.75 61.45 33.55 1.32 AVERAGE IP-FRAME CIFF / I-FRAME CIFF RATIO 3.54
16. FASTEST SPEED
17. “WEDDING” 1920x1080 25fps 4:2:0 Encoder Speed [fps] Decoder Speed [fps] CIFF-=CIFF WITH REDUCED LEVEL OF DETAILS. CR=COMPRESSION RATIO
18. “WEDDING” 1920x1080 25fps 4:2:0 Encoder Speed [fps] Decoder Speed [fps] CIFF-=CIFF WITH REDUCED LEVEL OF DETAILS. CR=COMPRESSION RATIO
19. INSTRUCTIONS PER PIXEL Encoding COLOR Decoding
20. INSTRUCTIONS PER PIXEL Encoding GRAYSCALE Decoding
21. LOWEST MEMORY SIZE
22. ENCODING MEMORY BUFFER Smallest encoding memory buffer 22..1427 times < JPEG 165..8992* times < JPEG2000 w/o tiles 56..868 times < JPEG2000 with 128x128 45..851 times < JPEG2000 with 32x32 * = lack of memory in 1GB PC
23. DECODING MEMORY BUFFER Smallest decoding memory buffer 19..857 times < JPEG 116..8129* times < JPEG2000 w/o tiles 42..866 times < JPEG2000 with 128x128 31..906 times < JPEG2000 with 32x32 * = lack of memory in 1GB PC
Different resolutions in the bitstream 24. SPATIAL SCALABILITY Different resolutions in the bitstream QCIF CIF SDTV HDTV
25. SPATIAL SCALABILITY HDTV 1920x1080 ¼ QCIF QCIF 120x68 240x135 CIF SDTV 960x540
26. SPATIAL SCALABILITY BENEFITS UDTV streaming from UAS UDTV extraction in GCS HDTV extraction in a notebook SDTV extraction in a toughbook CIF extraction in PDA Simultaneous receiption of all resolutions Instant resolution change Instant bandwidth change Decoder power savings
27. TEMPORAL SCALABILITY Improving quality by decreasing frame rate
28. TEMPORAL SCALABILITY BENEFITS HDTV frame rate from close UAS Dropping selected HDTV frames SDTV frame rate from far UAS Dropping selected SDTV frames Quality increase with dropping frames Bandwidth savings Encoder power savings Decoder power savings Avoids MPEG dropping problems
decompressing more bits 29. QUALITY SCALABILITY Improving quality by decompressing more bits from the bitstream
30. QUALITY SCALABILITY BENEFITS Operator selectable Faster video encoding Smaller encoder latency Smaller encoder cost Encoder power savings Faster video decoding Smaller decoder latency Smaller decoder cost Decoder power savings
31. EFFECT OF ERRORS DURING TRANSMISSION (BER=1.E-4) JPEG2000 / CIFF MOTION JPEG MPEG-2 MPEG-4 & H.264
32. ERROR RESILIENCE BENEFITS #1 Better quality of each frame No error propagation Frame blur vs. MPEG blocks Smaller bandwidth with less FEC Best quality without jamming Best quality during jamming Without FEC at 1.E-6 BER for HDTV Without FEC at 1.E-5 BER for SDTV Without FEC at 1.E-4 BER for CIF
33. ERROR RESILIENCE BENEFITS #2 Simpler FEC can be used Faster FEC encoding Smaller encoder latency Smaller encoder cost Encoder power savings Faster FEC decoding Smaller decoder latency Smaller decoder cost Decoder power savings
34. DEFENSE APPLICATIONS Unmanned & manned vehicles Warfighters Satellites Surveillance Telemedicine Smart weapons Loitering weapons Face recognition for laser-guided bullets EO, IR, SAR & Hyperspectral sensors
35. UAS WITH ANALOG LINK UAV ANALOG LINK GROUND STATION EO IR SAR COMPUTER MONITOR STORAGE
FAST ENCODING/DECODING 36. UAS WITH ANALOG LINK FAST ENCODING/DECODING LOW LATENCY SMALL WEIGHT & SIZE LOW POWER & HEAT INTEROPERABILITY UAV EO IR SAR ANALOG LINK GROUND STATION PC PDA COMPUTER MONITOR STORAGE CIFF DECODER CIFF DECODER CIFF ENCODER (OPT)TRANS- CODER TO MPEG-2/4 COMPUTER MONITOR COMPUTER MONITOR
FAST ENCODING/DECODING 37. UAS WITH DIGITAL LINK FAST ENCODING/DECODING HIGH ERROR RESILIENCE LOW LATENCY SMALL WEIGHT & SIZE LOW POWER & HEAT INTEROPERABILITY UAV CIFF ENCODER EO IR SAR DIGITAL LINK GROUND STATION PC PDA CIFF DECODER STORAGE CIFF DECODER CIFF DECODER COMPUTER MONITOR (OPT)TRANS- CODER TO MPEG-2/4 COMPUTER MONITOR COMPUTER MONITOR
FAST ENCODING/DECODING 38. UAS WITH NETWORK LINK FAST ENCODING/DECODING HIGH ERROR RESILIENCE LOW LATENCY SMALL WEIGHT & SIZE LOW POWER & HEAT INTEROPERABILITY UAV CIFF ENCODER EO IR SAR NETWORK UDP LINK GROUND STATION PC PDA CIFF DECODER STORAGE CIFF DECODER CIFF DECODER COMPUTER MONITOR (OPT)TRANS- CODER TO MPEG-2/4 COMPUTER MONITOR COMPUTER MONITOR
39. HIGH BANDWIDTH CIFF BENEFITS Example 100 Mbps link EDTV color 8192x4096x15 fps EDTV grayscale 8192x4096x30 fps UDTV color 3x3840x2160x25 fps UDTV grayscale 5x3840x2160x25 fps HDTV color 10x1920x1080x25 fps HDTV grayscale 20x1920x1080x25 fps
CDL LOS 274 Mbps 137 Mbps CDL LOS 10.71 Mbps
41. MID BANDWIDTH CIFF BENEFITS Example 10 Mbps link EDTV color 8192x4096x1.5 fps EDTV grayscale 8192x4096x3 fps UDTV color 3840x2160x6 fps UDTV grayscale 3840x2160x12 fps HDTV color 1920x1080x25 fps HDTV grayscale 2x1920x1080x25 fps SDTV color 4x720x480x30 fps SDTV grayscale 8x720x480x30 fps
Ku BAND 47.9/40 Mbps 30/20 Mbps 8.67/1.5 Mbps LINK-16 238 kbps 115.2 kbps 57.6 kbps 31.6 kbps
43. LOW BANDWIDTH CIFF BENEFITS Example 238 kbps link UDTV color 3840x2160x0.3 fps UDTV grayscale 3840x2160x0.6 fps HDTV color 1920x1080x0.6 fps HDTV grayscale 1920x1080x1.2 fps SDTV color 720x480x3 fps SDTV grayscale 720x480x6 fps
44. HARDWARE FOR NEW ASSETS Lowest cost No dividers No multipliers Ultralow power Integer arithmetic Very low complexity Small integrated memory Ultrafast encoding and decoding 1 square mm silicon for UDTV
45. PROPOSED CHIP FEATURES 1920 x 1080 x 30fps 35MHz 20mW 3840 x 2160 x 30fps 140MHz 80mW 8192 x 4096 x 20fps 350MHz 200mW 1920 x 1080 x 300fps 350MHz 200mW Slow-motion 10 x HD frame rate Additional circular buffer for slow-motion frames for detailed post-event analysis Preliminary design data before full RTL core simulation
46. CIFF CONTAINER BENEFITS Future proof container format Any video codec as plug-in Any audio codec as plug-in Any metadata codec as plug-in Any control codec as plug-in Any encryption as plug-in Any error correction as plug-in Any packetization as plug-in Multiple streams are synchronized
47. WIRELESS HDMI NETWORK DVR FUNCTION ON THE ROAD
48. CIFF HDMI CONNECTION INSTEAD OF CLASSIC WIRED HDMI HDMI CIFF Tx HDMI CIFF Rx CIFF P2P WIRELESS HDMI LINK HDMI CIFF Tx HDMI CIFF Rx CIFF ROUTED WIRELESS HDMI LINK
Transmitter at HDMI out port Receiver at HDMI in port 49. CIFF HDMI NODE Wireless HDMI IEEE802.11g/n Wired HDMI 10/100/1000 Base-T Transmitter at HDMI out port Receiver at HDMI in port AES-GCM-AEAD 256-bit encryption Single chip without external memory TRANSMIT CIFF Node HDMI Rx 32bit RISC CIFF Enc 802.11g RECEIVE CIFF Node HDMI Tx 32bit RISC CIFF Dec 802.11g
CIFF TECHNOLOGY CORPORATION DIRECTORS, OWNERS & ASSIGNEES OF CIFF PATENT APPLICATION ARE: Prof. dr. Milan Prokin, dipl. ing. Vladimir Čeperković, dipl. ing. Saša Pavlović Dušan Mirković CIFF PATENT APPLICATIONS IN: USA, Canada, Europe, Japan South Korea, China (granted), Serbia, PCT WORLDWIDE CIFF REPRESENTATIVE: Prof. dr. Milan Prokin, dipl. ing.
CIFF TECHNOLOGY CORPORATION CIFF BUSINESS ENTERPRISES LLC Prof. dr. Milan Prokin +381-11-3016-595, +381-11-3016-596 +1-310-880-9030, +381-64-4557-702 proka@el.etf.rs, milan.prokin@gmail.com CIFF BUSINESS ENTERPRISES LLC Michael Collins +1-410-326-3001 +1-410-320-7906 mc@ciffbe.com, mc@networxusa.com