[논문 리뷰] 9

[논문 리뷰] Seq2Seq: Sequence to Sequence Learning with Neural Networks

논문: https://arxiv.org/abs/1409.3215저자: Ilya Sutskever - ilyasu@google.com, Oriol Vinyals - vinyals@google.com, Quoc V. Le - qvl@google.com인용: Sutskever, I. "Sequence to Sequence Learning with Neural Networks." arXiv preprint arXiv:1409.3215 (2014).   0. 초록 (Abstract) 심층신경망 (Deep Neural Networks, DNNS)은 대규모 라벨 데이터셋이 존재한다면, 여러 테스크에 대해 좋은 성능을 보여주었다. 하지만 문장 번역에 대해서는 그렇지 않다. 저자는 언어 구조에 대한 최소한의 조건으로 문..

[논문 리뷰] A deep learning-based surface defect inspection system using multiscale and channel-compressed features

논문: https://ieeexplore.ieee.org/document/9063543 저자: Jiangxin Yang , Guizhong Fu , Wenbin Zhu , Yanlong Cao , Yanpeng Cao , Member, IEEE, and Michael Ying Yang, Senior Member, IEEE 인용: Yang, Jiangxin, et al. "A deep learning-based surface defect inspection system using multiscale and channel-compressed features." IEEE transactions on instrumentation and measurement 69.10 (2020): 8032-8042. 깃허브: ..

[논문 리뷰] LSTM: Long Short-Term Memory

논문: https://ieeexplore.ieee.org/abstract/document/6795963 저자: Sepp Hochreiter(Fakultät für Informatik, Technische Universität München, 80290 München, Germany), Jürgen Schmidhuber(IDSIA, Corso Elvezia 36, 6900 Lugano, Switzerland) 인용: S. Hochreiter and J. Schmidhuber, "Long Short-Term Memory," in Neural Computation, vol. 9, no. 8, pp. 1735-1780, 15 Nov. 1997, doi: 10.1162/neco.1997.9.8.1735. 참고:1..

[논문 리뷰] Attention: Neural Machine Translation by Jointly Learning to Align and Translate

논문: https://arxiv.org/abs/1409.0473 저자: Dzmitry Bahdanau (Jacobs University Bremen, Germany) KyungHyun Cho and Yoshua Bengio* (Universit´e de Montr´eal)* CIFAR Senior Fellow 인용: Bahdanau, Dzmitry. "Neural machine translation by jointly learning to align and translate." arXiv preprint arXiv:1409.0473 (2014).  튜토리얼 코드: https://tutorials.pytorch.kr/intermediate/seq2seq_translation_tutorial.html 데이터..

[논문 리뷰] LORA: Low-Rank Adaptation of Large Language Models

논문: https://arxiv.org/abs/2106.09685 저자: Edward Hu* Yelong Shen* Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li SheanWang Lu Wang Weizhu Chen (Microsoft Corporation)*Equal contribution 인용: Hu, Edward J., et al. "Lora: Low-rank adaptation of large language models." arXiv preprint arXiv:2106.09685 (2021).  깃허브: https://github.com/microsoft/LoRA 0. 초록 (Abstract) NLP에 대한 주요 인식은 일반적인 데이터로 대규모 사전학습한 모델을 특..

[논문 리뷰] Focal Loss for Dense Object Detection (RetinaNet)

논문: https://arxiv.org/abs/1708.02002 저자: Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollar. Facebook AI Research (FAIR)  인용: Ross, T-YLPG, and G. K. H. P. Dollár. "Focal loss for dense object detection." proceedings of the IEEE conference on computer vision and pattern recognition. 2017.  깃허브: https://github.com/facebookresearch/Detectron 주: 게시글 아래 RetinaNet ICCV 2017 구두발표 영상과 영..

[논문 리뷰] Complex-Object Visual Inspection via Multiple Lighting Configurations

논문: https://arxiv.org/abs/2004.09374 저자: Maya Aghaei, Matteo Bustreo, Pietro Morerio, Nicolo Carissimi, Alessio Del Bue, Vittorio Murino Pattern Analysis and Computer Vision (PAVIS), Istituto Italiano di Tecnologia (IIT), Genova, Italy 인용: Aghaei, Maya, et al. "Complex-Object Visual Inspection via Multiple Lighting Configurations." arXiv preprint arXiv:2004.09374 (2020). 0. 초록 (Abstract)   자동 시각..

[논문 리뷰] Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces

논문: https://www.sciencedirect.com/science/article/pii/S088832702200276X 저자: Guizhong Fu, Shukai Jia, Wenbin Zhu, Jiangxin Yang, Yanlong Cao, ichael Ying Yang, Yanpeng Cao (Corresponding author) 인용: Fu, Guizhong, et al. "Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces." Mechanical Systems and Signal Processing 175 (2022): 109109. 깃허브: ..

[논문 리뷰] SupCon: Supervised Constrastive Learning

논문: https://proceedings.neurips.cc/paper_files/paper/2020/hash/d89a66c7c80a29b1bdbab0f2a1a94af8-Abstract.html 저자: Prannay Khosla (Google Research), Piotr Teterwak(Boston University), ChenWang (Snap Inc.), Aaron Sarna (Google Research, corresponding author), Yonglong Tian (MIT), Phillip Isola (MIT), Aaron Maschinot (Google Research), Ce Liu (Google Research), Dilip Krishnan (Google Research) 인용: ..