Dr. Shuen-Huei Guan | Technical Director of KKStream

Abstract: Video streaming (or more broadly OTT, over-the-top content) becomes the hot topic after giant players, including YouTube, Apple, Twitch, Netflix, Hulu, Amazon, and even Facebook. Netflix, among the list, leads the business, paradigm shift (cord cutting), content production and even streaming technology. In this casual talk, I'd like to try bring out some technical or operational issues and todos from streaming service provider's viewpoint. Let's see what we can discover from them to cook out new research topics or even startup ideas with practical needs.

drakeBio: Before joining the big trend of video streaming in KKBOX (and then KKStream), Drake has been serving as R&D manager and technology pioneer in Digimax, an animation studio, for 9 years. He was fortunate to participate some animation projects with partners like National Palace Museum (故宮博物院), NASA Jet Propulsion Laboratory (JPL), U-Theatre (優人神鼓) and even Pixar's RenderMan team. He started as a Computer Graphics researcher (SIGGRAPH maniac), stereoscopic vision lover, casual movie fan and then video streaming pioneer in Taiwan. He believes people first than technology even though his background is in STEM.

We are happy to announce the accepted papers in the four exciting special sessions this year. Congratulations!

  • Towards Fully Offloaded Cloud-based AR: Design, Implementation and Experience
    Ryan Shea (Simon Fraser University)
    Andy Sun (Simon Fraser University)
    Silvery Fu (Simon Fraser University)
    Jiangchuan Liu (Simon Fraser University)
  • Time Evaluation for the Integration of a Gestural Interactive Application with a Distributed Mulsemedia Platform
    Estêvão Bissoli Saleme (IFES)
    Jordano Ribeiro Celestrini (IFES)
    Celso Alberto Saibel Santos (UFES)
  • Can Multisensorial Media Improve Learner Experience?
    Longhao Zou (Dublin City University)
    Irina Tal (Dublin City University)
    Alexandra Covaci (Brunel University London)
    Eva Ibarrola (University of the Basque Country)
    Gheorghita Ghinea (Brunel University London)
    Gabriel-Miro Muntean (Dublin City University)
  • Navigable Videos for Presenting Scientific Data on Affordable Head-Mounted Displays
    Jacqueline Chu (University of California, Davis)
    Chris Bryan (University of California, Davis)
    Min Shih (University of California, Davis)
    Leonardo Ferrer (University of California, Davis)
    Kwan-Liu Ma (University of California, Davis)
  • Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP
    Mario Graf (Bitmovin Inc.)
    Christian Timmerer (Alpen-Adria-Universität Klagenfurt / Bitmovin Inc.)
    Christopher Müller (Bitmovin Inc.)
  • Hyperion: A Wearable Augmented Reality System for Text Extraction and Manipulation in the Air
    Dimitris Chatzopoulos (The Hong Kong University of Science and Technology)
    Carlos Bermejo (The Hong Kong University of Science and Technology)
    Zhanpeng Huang (The Hong Kong University of Science and Technology)
    Arailym Butabayeva (The Hong Kong University of Science and Technology)
    Rui Zheng (The Hong Kong University of Science and Technology)
    Morteza Golkarifard (Sharif University of Technology)
    Pan Hui (The Hong Kong University of Science and Technology)
  • Modeling User Quality of Experience (QoE) through Position Discrepancy in Multi-sensorial, Immersive, Collaborative Environments
    Shanthi Vellingiri (UTD)
    Prabhakaran Balakrishnan (UTD)
  • A Visual Latency Estimator for 3D Tele-Immersion
    Suraj Raghuraman (The University of Texas at Dallas)
    Kanchan Bahirat (The University of Texas at Dallas)
    Balakrishnan Prabhakaran (The University of Texas at Dallas)
  • Automatic Discovery of Surveillance Devices in the Cyberspace
    Qiang Li (School of Computer and Information Technology, Beijing Jiaotong University)
    Xuan Feng (Institute of Information Engineering, Chinese Academy of Sciences)
    Haining Wang (University of Delaware)
    Limin Sun (Institute of Information Engineering, Chinese Academy of Sciences)
  • WiFi Network Access Control for IoT Connectivity with Software Defined Networking
    Michael Baird (Victoria University of Wellington)
    Bryan Ng (Victoria University of Wellington)
    Winston K. G. Seah (Victoria University of Wellington)
  • COMMIT: A Multimedia Collaboration System for Future Workplaces with the Internet of Things
    Kutalmis Akpinar (University of Central Florida)
    Trevor Ballard (University of Central Florida)
    Kien Hua (University of Central Florida)
    Kai Li (University of Central Florida)
    Sansiri Tarnpradab (University of Central Florida)
    Jun Ye (University of Central Florida)

Wesley Kuo | Founder of i@solution & Ubitus

Abstract: To share Ubitus' experience on cloud game streaming across multiple platforms with broader business reach; provide global market trend and application examples. Then convey problems to overcome and how to catch the new business opportunities including VR, 4K and console markets.


Bio: %e6%9c%aa%e5%91%bd%e5%90%8d

  • 2000 found i@soluiton Inc. covered 40% market share of Java phone market with world leading J2ME tech solution.
  • 2004 sold to Aplix at NTD 2.4 billion.
  • 2007 found Ubitus Inc. focusing on streaming technology.

Ubitus now owns the world-leading N-screen cloud gaming platform and is building up new advertising business: C2P and VR/AR ads solution. Proven record with Google, nVIDIA, Alibaba, Samsung, LG, NTT docomo etc. Employees across Taiwan, China, USA, Japan, Korea. NTT docomo and Samsung are our strategic investors.

The first keynote for ACM MMSys 2017 is confirmed and will be held by Prof. Henry Fuchs, the Federico Gil Distinguished Professor of Computer Science and Adjunct Professor of Biomedical Engineering at UNC Chapel Hill.

The AR/VR Renaissance: opportunities, pitfalls, and remaining problems | Prof. Henry Fuchs | University of North Carolina at Chapel Hill, United States

Abstract: Augmented and virtual reality are hailed today as “the next big thing,” the next personal computing platform, logical successors to the previous three generations of PCs, laptops, and mobile.  Others worry that today’s AR and VR systems are not yet sufficiently advanced for mass adoption, that they are more like the 1990s Apple Newton than the 2007 Apple iPhone — exciting proofs of concept, but not yet useful nor cost-effective for most consumers. This talk will review the historical development of AR and VR technologies, and survey some representative current work, sample applications, and remaining problems. Current work with encouraging results include 3D scene capture and 3D reconstruction of dynamic, populated spaces; compact and wide field-of-view AR displays; low-latency and high-dynamic range AR display systems; and near-eye lightfield displays that may reduce the vergence-accommodation conflicts that plague current AR and VR display designs.

fuchs2014aBio: Henry Fuchs (PhD, Utah, 1975) is the Federico Gil Distinguished Professor of Computer Science and Adjunct Professor of Biomedical Engineering at UNC Chapel Hill, coauthor of over 200 papers, mostly on rendering algorithms (BSP Trees), graphics hardware (Pixel-Planes), head-mounted / near-eye and large-format displays, virtual and augmented reality, telepresence, medical and training applications. He is a member of the National Academy of Engineering, a fellow of the American Academy of Arts and Sciences, recipient of the 2013 IEEE VGTC Virtual Reality Career Award, and the 2015 ACM SIGGRAPH Steven Anson Coons Award.

Ragnhild Eg | Westerdals Oslo School of Arts, Norway

Abstract: Computers make humans wait. When interacting with a computer system, no response is instant; every key stroke or mouse movement must be processed before the output is rendered and presented. If signals have to travel across a network, the waiting time, or latency, can extend into the perceptible and further into the detrimental. In addressing perceptible delays between motor inputs and visual outputs, different communities use different jargons. Yet they share a common interest in the perceptual and cognitive consequences of lagging responses. This talk will give an overview of current insights about temporal human-computer interactions, presenting findings from HCI, multimedia and psychological research.

ragnhild-profilBio: Ragnhild Eg is an associate professor at Westerdals Oslo School of Arts, Communication and Technology, where she combines her background and interest in perceptual psychology with digital marketing. She completed a PhD in psychology at the University of Oslo while working at Simula Research Laboratory. At Simula, she was part of a multi-disciplinary project that focused on the human perception of multimedia. Current projects relate to temporal human-computer interactions and the impact of delayed responses on performance. Ragnhilds research interests relate to the perceptual processing and integration of sensory information, particularly how the perceptual process is affected by the constraints imposed by technology.

ACM MMSys 2017 will also feature a series of industrial talks and one of them will be held by Mr. Raymond Pao from HTC.

Virtual Reality: The New Era of Future World | Raymond Pao | VP, VR New Technology, HTC VIVE

Abstract: Virtual Reality (VR) has been one of the hottest topics since 2016. It starts to revolutionize the ways we used to have in terms of education, entertainment, gaming, design, retail, consumption patterns, social experiences…, and so on. Through this talk, people would start to know more about VR and step into the charming and unlimited VR world of imagination.

htc-vive_raymond-pao-%e9%ae%91%e6%b0%b8%e5%93%b2Bio: Mr. Raymond Pao is responsible for VR technology, strategic partnership, VR business in Asia Pacific, as well as creates the exceptional product and brand value on HTC Vive. He has abundant experience and knowledge in consumer electronics and technology. From 2006 to 2008, he worked with Google Android team and developed the world first Android Smartphone and was in charge of software development in Android platform. Mr. Pao received two Master Degrees in Mechanical Engineering from National Taiwan University and Electrical Engineering from University of Southern California.

Ketan Mayer-Patel | University of North Carolina at Chapel Hill, NC, USA

Abstract: There is a gap to be sparked between the fields of multimedia systems and computer vision. That gap is a vision-driven interface for rate controlled compressed video. Advances in vision have made real-world, real-time vision-based applications a reality. In doing so, there is now an imperative to integrate and negotiate systems-level tradeoffs with these vision algorithms as these real-world applications are realized. In this talk, I’ll motivate and propose a rate controlled interface extension for OpenCV to compressed video sources. I’ll discuss a possible compressed-domain implementation that is adaptable to a wide array of existing video standards. Finally, I’ll speculate about the potential impact of such an interface on future directions of research in vision-based multimedia systems.

ketan-mayer-patelBio: Ketan Mayer-Patel is an associate professor in the Department of Computer Science at the University of North Carolina at Chapel Hill. He received his Ph.D. in Computer Science in 1999 from the University of California at Berkeley. He was a recipient of an NSF CAREER award and is the current chair of the MMSys executive committee. His general research interest is in multimedia systems. Currently, he is investigating vision-based rate control, scalable display interfaces, and distributed archival video encoding.

Another overview talk at ACM MMSys 2017 will be held by Dr. Niall Murray from the Athlone Institute of Technology, Ireland.

Towards Understanding Truly Immersive Multimedia Experiences | Niall Murray | Athlone Institute of Technology, Ireland

Abstract: Immersive multimedia experiences have the possibility to engage users perceptually, cognitively and emotionally and there is significant interest due to their applicability across numerous application domains (film, entertainment, health, education, training, tourism, manufacturing). Important findings from psychological and neuroscience research, increased computational power, advances in sensor and display technologies are striving towards making truly immersive multimedia experiences a reality. In the context of various immersive, multimodal and mixed reality applications we have worked on; this talk will present an overview of our research towards understanding factors the make experiences immersive. It will focus on the user as the key stakeholder in the quality evaluation process. The talk will conclude by highlighting potential benefits, some trends and future research directions.

Bio: Dr.niall-murray Niall Murray (www.niallmurray.info) is a permanent Lecturer and researcher with the Faculty of Engineering and Informatics in the Athlone Institute of Technology (AIT), Ireland. He received his BE (Electronic and Computer Engineering) from National University of Ireland, Galway (2003), MEng (Computer and Communication Systems) from the University of Limerick (2004) and PhD from the Software Research Institute (SRI) in the Athlone IT in 2014.

Since 2004, he has worked in R&D roles across a number of industries: Telecommunications, Finance, Health and Education. In 2014 He founded the Truly Immersive and Interactive Multimedia Experiences lab (TIIMEx). His research interests include Immersive Multimedia Communication, Multisensory Multimedia, Quality of Experience and Multimedia Synchronization. In this context, TIIMEx builds and evaluates from a user perceived quality perspective, end-to-end communication systems and novel immersive and interactive applications.

ACM MMSys 2017 will feature a series of overview talks and one of them will be held by Prof. Geraldine Morin from University of Toulouse, France.

Geometric representations of 3D scenes | Geraldine Morin | University of Toulouse, France

Abstract: 3D content is spreading fast as a commonplace media. New technologies like 3D capture devices, head mounted display or 3D printers as well as numerous applications like e-commerce to virtual visits are fostering the use of 3D models. Starting from classical geometric representations limited to dedicated context (CAM-CAD, or game development), adapted models have to be devised in order to meet the constraints imposed by such different application contexts and technologies.

The goal of this talk is to give an overview of the different geometric representations (discrete or continuous, with and without topology) and their advantages and drawbacks. We introduce the existing adaptations of these models for creating, manipulating or sharing these models and their adaptation to specific multimedia applications. In particular, we review 3D compression, 3D model analysis for creation and edition based both on geometry and user interactions, and the different 3D characteristics for indexing 3D models.

Bio:geraldine-morin Géraldine Morin is an Associate Professor at University of Toulouse and a member of the IRIT (Institut de Recherche en Informatique de Toulouse), since 2002. She got her Ph.D. in Computer Science (geometric modeling) from Rice University, Houston, USA and she was a postdoc at the Free University in Berlin, Germany. In January 2014, she defended her habilitation on the use of 3D models as multimedia content. In addition to her recognized work in compact and progressive representation and streaming for 3D plant models (best paper ACM MM 2008), Géraldine Morin worked on image based representations. More recently, she worked on identifying similarities in a 3D model and 3D applications indexing. In addition, she participated in work on the analysis of user interactions to adapt 3D content and their interactions. She is currently interested in using skeletons for shape analysis and image based reconstruction. Géraldine Morin served a member of SIAM-Geometric Design Group office, she is an associate member of the French-Singaporean lab IPAL and she is co-head of the French Geometric Modeling Group; she participated in the program committee of several national and international conferences. She published 14 papers in international journals and 36 in international conferences and workshops, and co-advised 7 graduated Ph.D. students and is currently directing two.