Person Search

{:en}
  • Person Search

Person search has drawn considerable attention recently with the increasing demand for person re-identification from real world scene images. The conventional person re-identification takes a set of cropped person images and selects the images among them matching to a given query person. On the other hand, the person search methods directly find the query person from a set of scene images where multiple people may appear in a single image. Since the person search works on unconstrained images, it has a strong potential to be applied to numerous practical applications. For example, it can be used to deploy visual surveillance systems to monitor and trace the suspects from CCTV video sequences. Also, it can be applied to augmented reality systems with mobile camera devices to provide visual information useful for social entertainment.

On the other hand, collecting and labeling datasets for person search require significant cost of time and labor. To reduce the burden of labeling, we proposed weakly supervised person search for the first time, which does not require the identity labels of each person. Recently, to completely mitigate the burden of labeling and collecting dataset and also privacy concern, we utilized unreal dataset for training the person search network, introducing domain generalizable framework for the first time to alleviate domain gap between unreal and real datasets.

  • Publications
[1]Byeong-Ju Han, Kuhyeun Ko, and Jae-Young Sim. “End-to-end trainable trident person search network using adaptive gradient propagation.” Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.
[2]Byeong-Ju Han, Kuhyeun Ko, and Jae-Young Sim. “Context-aware unsupervised clustering for person search.”, 32nd British Machine Vision Conference 2021
[3]Minyoung Oh, Duhyun Kim, and Jae-Young Sim. β€œDomain Generalizable Person Search Using Unreal Dataset.”, AAAI2024

{:}{:ko}
  • μ‚¬λžŒ 검색

μ‚¬λžŒ 식별을 μ‹€μ œ ν™˜κ²½μ—μ„œ ν™œμš©ν•˜κΈ° μœ„ν•΄μ„œ μ‚¬λžŒ 검색은 졜근 λ§Žμ€ 관심을 λ°›μ•„μ™”λ‹€. 기쑴의 μ‚¬λžŒ 식별은 μ£Όμ–΄μ§„ 쿼리 μ‚¬λžŒμ„ μ‚¬λžŒμ…‹ μ—μ„œ μ°ΎλŠ”λ‹€. λ°˜λ©΄μ—, μ‚¬λžŒ 검색은 쿼리 μ‚¬λžŒμ„ μ—¬λŸ¬ μ‚¬λžŒμ΄ λ“±μž₯ν•˜λŠ” μ˜μƒμ…‹μ—μ„œ 직접 μ°ΎλŠ”λ‹€. μ œν•œμ΄ μ—†λŠ” μ˜μƒ μ…‹μ—μ„œ μ‚¬λžŒμ„ μ°ΎκΈ° λ•Œλ¬Έμ—, μ‚¬λžŒ 검색은 λ§Žμ€ μ‹€μ œ ν™˜κ²½μ—μ„œ ν™œμš©ν•  수 μžˆλŠ” κ°€λŠ₯성을 κ°€μ§€κ³  μžˆλ‹€. 예λ₯Ό λ“€μ–΄μ„œ, μ‚¬λžŒ 검색은 κ°μ‹œ 카메라 ν™˜κ²½μ—μ„œ λͺ¨λ‹ˆν„°λ§μ„ μœ„ν•΄μ„œ ν™œμš©λ  수 있고, CCTVλ₯Ό ν†΅ν•΄μ„œ λ²”μ£„μžλ₯Ό 좔적할 λ•Œ ν™œμš©λ  수 μžˆλ‹€. λ˜ν•œ λͺ¨λ°”일 μΉ΄λ©”λΌλ‘œ μ¦κ°•ν˜„μ‹€ μ‹œμŠ€ν…œμ— μ μš©ν•˜μ—¬ μ†Œμ…œ μ—”ν„°ν…Œμ΄λ¨ΌνŠΈμ— μœ μš©ν•œ μ‹œκ°μ  정보λ₯Ό μ œκ³΅ν•  수 μžˆλ‹€.

반면, μ‚¬λžŒ 검색을 μœ„ν•œ λ°μ΄ν„°μ…‹μ˜ λΌλ²¨λ§μ—λŠ” λ§Žμ€ 노동λ ₯κ³Ό μ‹œκ°„μ΄ ν•„μš”λ‘œ λœλ‹€. μ΄λŸ¬ν•œ 라벨링 뢀담을 μ™„ν™”ν•˜κΈ° μœ„ν•˜μ—¬ 우린 졜초둜 식별 정보λ₯Ό μ‚¬μš©ν•˜μ§€ μ•Šκ³  ν•™μŠ΅ν•˜λŠ” 약지도 ν•™μŠ΅ 기반 μ‚¬λžŒ 검색 κΈ°μˆ μ„ κ°œλ°œν•˜μ˜€λ‹€. μ΅œκ·Όμ—λŠ”, 라벨링 뢀담을 μ™„μ „νžˆ μ—†μ• κ³  μ΄ˆμƒκΆŒ 문제λ₯Ό ν•΄κ²°ν•˜κΈ° μœ„ν•˜μ—¬ λΉ„ν˜„μ‹€ 데이터λ₯Ό μ΄μš©ν•œ 도메인 μΌλ°˜ν™” μ‚¬λžŒ 검색 κΈ°μˆ μ„ 졜초둜 κ°œλ°œν•˜μ˜€λ‹€.

  • Publications
[1]Byeong-Ju Han, Kuhyeun Ko, and Jae-Young Sim. “End-to-end trainable trident person search network using adaptive gradient propagation.” Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.
[2]Byeong-Ju Han, Kuhyeun Ko, and Jae-Young Sim. “Context-aware unsupervised clustering for person search.”, 32nd British Machine Vision Conference 2021
[3]Minyoung Oh, Duhyun Kim, and Jae-Young Sim. β€œDomain Generalizable Person Search Using Unreal Dataset.”, AAAI2024

{:}