I am currently a video coding and processing researcher and developer at Apple.
I earned my Ph.D. degree in Electrical Engineering from Tandon School of Engineering at New York University in 2018. My academic adviser is Prof. Yao Wang, director of NYU Video Lab.
I earned my M.S. degree in Electrical Engineering from Polytechnic Institute of New York University in 2011.
I earned my B.S. degree in Electrical Engineering from Beijing Institute of Technology in 2009.
My research areas include video coding and processing, omni-directional video processing and streaming, computer vision, machine learning and artificial intelligence.
My email is: fanyi.duanmu (at) nyu (dot) edu
More About Me
Prior to joining Apple, I was collaborating with InterDigital and Huawei researchers on International standardization of video coding under Joint Collaborative Team on Video Coding (JCTVC) and Joint Video Exploration Team (JVET) and has co-signed 17 standard contributions and 3 patent/disclosures.
I am also an amateur clarinet performer and a passionate tennis and pingpong player. I like traveling and have visited 22 states in US, 3 provinces in Canada and 11 provinces in China.
My Recent News
[2021] Our patent entitled "Versatile Tile Coding For Multi-view Video Streaming" has been granted.
[2021] Our patent application entitled "Client-end Enhanced View Prediction for Multi-view Video Streaming Exploiting Pre-fetched Data and Side Information" has been submitted and published.
[2020] I am elected to attend MPEG meetings (ISO/IEC JTC 1/SC 29/WG 4) as an Apple representative.
[2019] Our paper entitled "An HEVC-Compliant Fast Screen Content Transcoding Framework Based on Mode Mapping" has been accepted and published by IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2019.
[2019] My patent application entitled "Multi-Type Tree Coding" has been published.
[2019] My patent application entitled "Hybrid Angular Cubemap Projection for 360-degree Video Coding" has been published.
[2019] Our paper entitled "A Two-Tier System for On-Demand Streaming of 360 Degree Video Streaming over Dynamic Networks" has been accepted and published by IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS), 2019.
[2019] I am elected as a TPC member for IEEE International Conference on Cyber, Physical and Social Computing (CPSCom-2019).
[2018] My patent entitled "Advanced coding techniques for high efficiency video coding (HEVC) screen content coding (SCC) extensions" has been granted.
[2018] I am elected as a TPC member for ACM Multimedia System Packet Video Workshop (PV-2019).
Experience
Video Coding and Processing Engineer, Apple, Cupertino, CA, USA, April 2018 - Present.
Video Codec Research Intern, InterDigital Communications, San Diego, CA, USA, Summer 2017.
Video Codec Research Intern, Huawei Technologies, Santa Clara, CA, USA, Summer 2015.
Video Codec Research Intern, Huawei Technologies, Santa Clara, CA, USA, Summer 2014.
Software Consultant, Siemens Health Services, Malvern, PA, USA, Winter 2011 - Spring 2013.
Publications
Patents
[P1] F. Duanmu, E. Asbun, X. Zhou, J. Xin, H. Wu, J. Su, S. Gehani, C. Flick, and S. Sahoo, "Versatile Tile Coding For Multi-view Video Streaming", US Patent 10,972,753, granted in 2021. [link]
[P2] H. Yu, M. Xu, W. Wang, F. Duanmu, and S. Minaee, "Advanced Coding Techniques For High Efficiency Video Coding (HEVC) Screen Content Coding (SCC) Extensions", US Patent 10,148,977, granted in 2018. [link]
[P3] F. Duanmu, A. Tourapis, J. Xin, H. Wu, and X. Zhou, "Client-end Enhanced View Prediction for Multi-view Video Streaming Exploiting Pre-fetched Data and Side Information", US Patent App No.16/825381, 2021. [link]
[P4] F. Duanmu, Y. He, and Y. Ye, "Hybrid Angular Cubemap Projection for 360-Degree Video Coding", US Patent App No. 62/621780, 2018. [link]
[P5] Y. He, F. Duanmu, X. Xiu and Y. Ye, "Multi-Type Tree Coding", US Patent App No. 62/617696, 2018. [link]
Dissertation
F. Duanmu, "Fast Screen Content Coding and Two Tier 360 Degree Video Streaming", NYU Tandon School of Engineering, Ph.D Dissertation, 2018. [link]
Journals
[J1] L. Sun, F. Duanmu, Y. Liu, Y. Wang, Y. Ye, H. Shi, and D. Dai, “A Two-Tier System for On-Demand Streaming of 360 Degree Video Streaming over Dynamic Networks,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS), Vol: 9, Issue: 1, Page: 43-57, 2019. (Impact Factor: 3.218) [download]
[J2] F. Duanmu, Z. Ma, M. Xu, and Y. Wang, "An HEVC-Compliant Fast Screen Content Transcoding Framework Based on Mode Mapping," IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2018. (Impact Factor: 3.558) [download]
[J3] F. Duanmu, Z. Ma, and Y. Wang, "Fast Mode and Partition Decision Using Machine Learning for Intra-Frame Coding in HEVC Screen Content Coding Extension," in IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS), Vol: 6, Issue: 4, Page:517-531, 2016. (Impact Factor: 3.218) [download]
[J4] J. Duan, J. Wu, F. Duanmu, W. Jing, "Method for Measuring Laser Energy Density Distribution," in Journal of Jilin University (Science Edition), Vol: 2, Issue: 2, pp: 311-316, 2009. [link]
Conferences
[C1] F. Duanmu, Y. Mao, S. Liu, S. Srinivasan and Y. Wang, "A Subjective Study of Viewer Navigation Behaviors When Watching 360-degree Videos on Computers," in Proc. of IEEE International Conference on Multimedia Expo (ICME), pp. 1-6, San Diego, California, USA, 2018. [download]
[C2] Y. He, X. Xiu, P. Hanhart, Y. Ye, F. Duanmu, and Y. Wang, "Content-Adaptive 360-degree Video Coding Using Hybrid Cubemap Projection," in Proc. of IEEE Picture Coding Symposium (PCS), pp. 313-317, San Francisco, California, USA, 2018. [download]
[C3] L. Sun, F. Duanmu, Y. Liu, Y. Wang, Y. Ye, H. Shi, and D. Dai, "Multi-path Multi-tier 360-degree Video Streaming in 5G Networks," in Proc. of ACM Multimedia System Conference (MMSys), pp. 162-173, Amsterdam, Netherland, 2018. [download]
[C4] F. Duanmu, X. Feng, X. Zhu, W. Tan, and Y. Wang, "A Multi-View Pedestrian Tracking Framework Based on Graph Matching," Invited paper to IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR), pp. 315-320, Miami, Florida, USA, pp. 315-320, 2018. [download]
[C05] F. Duanmu, Y. He, X. Xiu, P. Hanhart, Y. Ye, Y. Wang, "Hybrid Cubemap Projection Format for 360-Degree Video Coding," in Proc. of IEEE Data Compression Conference (DCC), pp. 404, Snowbird, Utah, USA, 2018. [download]
[C6] F. Duanmu, M. Xu, Y. Wang, and Z. Ma, "HEVC-Compliant Screen Content Transcoding Based on Mode Mapping and Fast Termination," in Proc. of IEEE Visual Communications and Image Processing Conference (VCIP), pp. 1-4, St. Petersburg, Florida, USA, 2017. [download]
[C7] F. Duanmu, E. Kurdoglu, A. Hosseini, Y. Liu and Y. Wang, "Prioritized Buffer Control in Two-Tier 360 Video Streaming," in Proc. of ACM SigComm Workshop (ACM SigComm’17 VR/AR Network), pp. 13-18, Los Angeles, California, USA, 2017. [download]
[C8] F. Duanmu, E. Kurdoglu, Y. Liu and Y. Wang, "View Direction and Bandwidth Adaptive 360 Degree Video Streaming using a Two-Tier System", in Proc. of IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-4, Baltimore, Maryland, USA, 2017. [download]
[C9] F. Duanmu, Z. Ma, W. Wang, M. Xu and Y. Wang, "A Novel Screen Content Fast Transcoding Framework Based on Statistical Study and Machine Learning", in Proc. of IEEE International Conference of Image Processing (ICIP), pp. 4205-4209, Phoenix, Arizona, USA, 2016. [download]
[C10] F. Duanmu, Z. Ma, and Y. Wang, "Fast CU Partition Decision Using Machine Learning for Screen Content Compression", in Proc. of IEEE International Conference on Image Processing (ICIP), pp. 4972 - 4976, Quebec City, Canada, 2015. [download]
[C11] Y. Xu, W. Huang, W. Wang, F. Duanmu, and Z. Ma "2-D Index Map Coding for HEVC Screen Content Compression", in Proc. of IEEE Data Compression Conference (DCC), pp. 263-272, Snowbird, Utah, USA, 2015. [download]
[C12] L. Song, T. Song, Y. Zhu, Q. Liu, F. Duanmu, and L. Yu, "Research on Space Coherent Laser Communication Technology", in Proc. of SPIE International Conference on Optical Instruments and Technology (OIT): Optoelectronic Measurement Technology and Applications, 71600Z, Beijing, China, 2009. [link]
Technical Report
[R1] F. Duanmu, "Screen Content Compression: A Brainstorming Report", Video Lab Archive, NYU Tandon School of Engineering, 2018. [download]
Selected Standard Contributions
[JVET-G0024] InterDigital’s Response to the 360º Video Category in Joint Call for Evidence on Video Compression with Capability beyond HEVC [link]
[JCTVC-U0188] New SCC test sequence for consideration [link]
[JCTVC-U0149] Non-CE1: Index Map Splitting (IMS) Mode for Palette Coding in HEVC SCC [link]
[JCTVC-U0148] Non-CE1: Context model unification for palette run type flags in HEVC SCC [link]
[JCTVC-R0304] Non-SCCE3: Improvements for SCCE3 Test C3 [link]
[JCTVC-R0269] Non-SCCE1: Analysis of Full Frame IBC Block Vector Distribution [link]
[JCTVC-R0268] Non-SCCE3: Results of SCCE3 with support of 2x4 CTUs as reference buffer [link]
Peer Review
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
IEEE Transactions on Image Processing (TIP)
IEEE Transactions on Multimedia (TMM)
IEEE/ACM Transactions on Networking (ToN)
IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS)
IEEE Transactions on Vehicular Technology (TVT)
IEEE Access
KSII Transactions on Internet and Information Systems (TIIS)
