Hello, welcome to my webpage.
I am Marie Curie research fellow at the University of Amsterdam, working with Ben Krose. I have a Marie Curie Postdoctoral Research fellowship on the AnaSID (Analysing Social Interactions from a Distance) project. Before that, I was a PostDoc at IDIAP working on multimodal meeting analysis for modelling dominance and influence in meetings, working with Daniel Gatica-Perez. Before this, I was at Queen Mary University Vision Group.
Workshop on Interactive Human Behaviour in Public Spaces to be held in conjuction with AmI 2011 on November 16 2011
(1997-1998)Year In Industry, QinetiQ (Formerly DERA) Malvern, UK.
(1998-2002)Electrical and Electronic Engineering, Imperial College, UK, MEng Course
(2002-2007 )PhD at QMUL on representing saliency in video. Partially funded by QinetiQ (2002-2005).
under supervision by Prof. Sean Gong. here's his web page
(2007-2010)Post-doc at IDIAP, Switzerland, on machine learning for human behavioural constructs in meeting scenarios using audio-visual cues.
My main research interests are concerned with automatic human behaviour understanding, social signal processing, computer vision, multimodal processing and machine learning. Research Page...
I have some open Masters thesis projects on automated human behavior analysis. Please get in touch if you would like to do your masters thesis on this topic.
People I am currently supervising:
Jeroen Kools (Artificial Intelligence MSc Thesis Project) with Gwenn Englebienne. (Analysing Social Behaviour in Crowds using Accelerometer Data)
Domenic Vossen (Artificial Intelligence MSc Thesis Project - MatchMakers) (Speaker Detection from Multi-modal Sensor Data) with Ben Krose and Gwenn Englebienne.
People I have supervised:
Arno Veenstra (Artificial Intelligence Msc Thesis Project - MatchMakers 2011) (Predicting Desires and Perceptions during Speed-Dates using Automatically Extracted Cues)
Gokul T. Chittaranjan (MSc Intern, 2009) Detecting Successful and Unsuccessful Lying in Role-Playing Games
Hayley Hung, "FROM VISUAL SALIENCY TO VIDEO BEHAVIOUR UNDERSTANDING", PhD Thesis, Department of Computer Science, Queen Mary University, 2007.
G. Chittaranjan and H. Hung, "Using Nonverbal Cues to Detect Deceptive Roles in Conversational Role-Playing Games", under review.
H. Hung, Y. Huang, G. Friedland, D. Gatica-Perez, "Estimating Dominance In Multi-Party Meetings Using Speaker Diarization", IEEE Transactions on Audio, Speech and Language Processing, Volume 19, Issue 4, pages 847-860, May 2011, :pdf.
G. Friedland, C. Yeo, and H. Hung, "Dialocalization: Acoustic Speaker Diarization and Visual Localization as Joint Optimization Problem", ACM Transactions on Multimedia Computing, Communications and Applications, Special Issue on Sensor Fusion, Vol. 6, No. 4, November 2010.
H. Hung, G. Friedland, and C. Yeo, "Computationally Efficient Clustering of Audio-Visual Meeting Data", in Multimedia Interaction and Intelligent User Interfaces: Principles, Methods and Applications in the Series Advances in Pattern Recognition, 25-59, Springer, Shao, L.; Shan, C.; Luo, J.; Etoh, M. (Eds.), November 15, 2010.pdf
H. Hung and D. Gatica-Perez, "Estimating Cohesion in Small Groups using Audio-Visual Nonverbal Behavior", IEEE Transactions on Multimedia, Vol. 12, No. 6, Oct. 2010.pdf.
D. Jayagopi, H. Hung, C. Yeo and D Gatica-Perez, "Modeling Dominance in Group Conversations using Non-verbal Activity Cues",IEEE Trans. on Audio, Speech, and Language Processing, Special Issue on Multimodal Processing for Speech-based Interactions, Vol. 17, No. 3, pp. 501-513. Mar. 2009
H. Hung, J.-M. Odobez, D. Gavrila, "International Workshop on Interactive Human Behavior Analysis in Open or Public Spaces", to appear in the workshop proceedings of the International Joint Conference on Ambient Intelligence, Amsterdam, 2011.
H. Hung, J.-M. Odobez, D. Gavrila, "Interactive Human Behavior Analysis in Open or Public Spaces", in the International Joint Conference on Ambient Intelligence, Amsterdam, 2011.
A. Veenstra and H. Hung, "Do They Like Me? Using Video Cues to Predict Desires during Speed-dates", IEEE International Conference on Computer Vision Workshops,p. 838-845, Barcelona, Spain, 2011. (Oral Presentation): pdf
N. Raiman, G. Englebienne, and H. Hung, "Move, and I will tell you who you are: Detecting deceptive roles in low-quality data", International Conference on Multimodal Interaction, Alicante, Spain, November 2011: pdf corpus
H. Hung and B. Krose, "Detecting F-formations as Dominant
Sets", in International Conference on Multimodal
Interaction, Alicante, Spain, November 2011.(Oral Presentation): pdf
Nominated for Outstanding Paper
H. Hung and C. Jacquemin, "Encounter (Resonances)", in ACM Multimedia, Florence, Italy,1421-1424, October, 2010:pdf video.
H. Hung and G. Chittaranjan, "The Idiap Wolf Corpus: Exploring group behaviour in a competitive role-playing game", in ACM Multimedia, Florence, Italy, 879-882, October, 2010:pdf corpus.
Oya Aran, Hayley Hung, Daniel Gatica-Perez, "A Multimodal Corpus for Studying Dominance in Small Group Conversations", LREC workshop on Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, Malta, May 2010:pdf
G. Chittaranjan and H. Hung, "Are You A Werewolf? Detecting Deceptive Roles And Outcomes in a Conversational Role-Playing Game", in ICASSP, Dallas, Texas, USA, March 14-19, 2010:pdf
G. Friedland, C. Yeo and H. Hung, "Visual Speaker Localization Aided by Acoustic Models", ACM Multimedia, Beijing, China, October 19-24, 2009.
S.O. Ba, H. Hung and J.-M. Odobez. "Visual activity context for focus of attention estimation in dynamic meetings", International Conference on Multimedia and Expo (ICME), June 2009:pdf
G. Friedland, H.Hung, C.Yeo,"Multi-Modal Speaker Diarization of Real-World Meetings using Compressed-Domain Video Features", International Conference on Acoustics, Speech and Signal Processing, Taipei, April 2009:pdf .
D. Jayagopi, H.Hung, C. Yeo, and D. Gatica-Perez, "Predicting the dominant clique in meetings through fusion of nonverbal cues", in Proc. ACM Multimedia, Vancouver, Canada, October 27-November 1, 2008:pdf.
H.Hung, D. Jayagopi, S. Ba, J-M. Odobez, and D. Gatica-Perez, "Investigating automatic dominance estimation in groups from visual attention and speaking activity", in the International Conference on Multimodal Interfaces (ICMI 2008), Chania, Greece, October 20-22, 2008:pdf (Oral Presentation)
H.Hung and G. Friedland, "Towards Audio-Visual On-line Diarization Of Participants In Group Meetings", in Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications in conjunction with ECCV, Marseille, France, October 18, 2008:pdf.
H.Hung and D. Gatica-Perez, "Identifying Dominant People in Meetings from Audio-Visual Sensors", in the International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September 17-19, 2008:pdf (Oral Presentation)
H. Hung, Y. Huang, C. Yeo, D. Gatica-Perez, "Associating Audio-Visual Activity Cues in a Dominance Estimation Framework", First IEEE Workshop on CVPR for Human Communicative Behavior Analysis, Anchorage, Alaska, Monday June 28th, 2008:pdf
H. Hung, Y. Huang, G. Friedland, and D. Gatica-Perez, "Estimating The Dominant Person In Multi-Party Conversations Using Speaker Diarization Strategies", International Conference on Acoustics, Speech and Signal Processing, Las Vegas, March 2008:pdf
H. Hung, D. Jayagopi, C. Yeo, G. Friedland, S. Ba, J-M. Odobez, N. Mirghafori, K. Ramchandran, D. Gatica-Perez, "Using Audio and Video Features to Classify the Most Dominant Person in a Group Meeting", Proc. ACM Multimedia, Augsburg, Germany, September 2007 : pdf
H. Hung and S. Gong, "Identification of human interaction from a distance using salient body behaviour modelling", Proc. SPIE Conference on Optics and Photonics for Counter-Terrorism and Crime-Fighting, Stockholm, September 2006,Vol. 6402, 640203.(Oral Presentation)
H. Hung and S. Gong, "Detecting and Quantifying Unusual Interactions by Correlating Salient Motion ", Proc. IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS'05), Como, Italy, p46-51, pdf (Oral Presentation)
H. Hung and S. Gong, "Quantifying Temporal Saliency", Proc. British Machine Vision Conference (BMVC'04), Kingston, UK, p727-736, pdf
H. Hung and S. O. Ba, SPEECH/NON-SPEECH DETECTION IN MEETINGS FROM AUTOMATICALLY EXTRACTED LOW RESOLUTION VISUAL FEATURES, Idiap Research Report, 2010 pdf
D. Jayagopi, H. Hung, C. Yeo, D. Gatica-Perez, "Modeling Dominance in Group Conversations using Non-verbal Activity Cues", IDIAP Research Report rr-07-78, 2007.
T. Xiang, M. Aurnhammer, S. Gong, H. Hung and A. Graves. "INSIGHT and Beyond: CCTV video data analysis and evaluation (Phase I)". Technical Report, Department of Computer Science, Queen Mary, University of London, July 2004.
H Hung, "Towards modelling the Semantics of Natural Human Body Movement", PhD-MPhil Transfer report, 2003
2009: First Prize, The IET Written Premium Competition, "Who's the Boss?: From Social Pyschology to Social Signal Processing",. Other winning entries for this competition can be found here..
2006: Second Prize, The IET Written Premium Competition, "Spotting the bad guys - A journey from surveillance video to automated crime fighting" .
2005: RAeng travel bursary.
1999: Lucent Technologies Global Science Scholarship.
1998: Sponsorship from Qinetiq Ltd during first degree.
1998: West Midlands Runner Up Young Engineer for Britain Award and Year in Industry Scheme West Midlands Runner Up Bursary Award for design of an automatic self-aligning antenna.