Home

Welcome to the Neural Coding Lab at the Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands. We are an interdisciplinary group of artificial intelligence and cognitive neuroscience researchers combining neural coding with deep learning to simulate and emulate in vivo neural computation with in silico connectionism for "brain-reading and -writing". tl;dr: 🧠 + 🤖 = ❤️.

People


Member


Dr. Umut Güçlü
Principal Investigator

Burcu Küçükoğlu
Doctoral Candidate

Djamari Oetringer
Doctoral Candidate

Dora Gözükara
Doctoral Candidate

Florian Mahner
Doctoral Candidate

Funda Yılmaz
Doctoral Candidate

Jaap de Ruyter van Steveninck
Doctoral Candidate

Kieran Carrigg
Doctoral Candidate

Lynn Le 🧗
Doctoral Candidate

Michelle Appel
Doctoral Candidate

Sahel Azizpourlindy
Doctoral Candidate

Thirza Dado
Doctoral Candidate

Vivek Sharma
Doctoral Candidate

Dr. Antonio Lozano
Affiliate Member

Dr. Katja Seeliger
Affiliate Member

Dr. Yağmur Güçlütürk
Affiliate Member

Feyisayo Olalere
Affiliate Member

Melle van der Heijden
Affiliate Member

Mo Nipshagen
Affiliate Member

Bruno Rovoletto
Master's Student

Dominik Schmid-Schickhardt
Master's Student

Lefteris Papadopoulos
Master's Student

Rosie Zheng
Master's Student

Gamze Kantar
Bachelor's Student

Gergana Slaveykova
Bachelor's Student

Buffy
Yorkie


Alumnus


Gabriëlle Ras
Doctoral Candidate

Katja Seeliger
Doctoral Candidate

Amanda Wintermans
Master's Student

Bea Waelbers
Master's Student

Berfu Karaca
Master's Student

Domantas Giržadas
Master's Student

Florian Mahner
Master's Student

Freek van den Bergh
Master's Student

Guus van der Ham
Master's Student

Heleen Visserman
Master's Student

Jordy Thielen
Master's Student

Kevin Koschmieder
Master's Student

Lars Bokkers
Master's Student

Luke Peters
Master's Student

Lynn Le
Master's Student

Marleen Voorn
Master's Student

Maureen van der Grinten
Master's Student

Mikhail Bulygin
Master's Student

Mo Nipshagen
Master's Student

Nils Kimman
Master's Student

Orhan Soyuhoş
Master's Student

Roel Hacking
Master's Student

Rowan Sommers
Master's Student

Sam Danen
Master's Student

Simon Kern
Master's Student

Stijn van Lierop
Master's Student

Sven den Hartog
Master's Student

Thirza Dado
Master's Student

Thomas Churchman
Master's Student

Zuzanna Fendor
Master's Student

Bas Krahmer
Bachelor's Student

Clemens Beissel
Bachelor's Student

Didi Kemper
Bachelor's Student

Dominik Schmid-Schickhardt
Bachelor's Student

Harm van den Brand
Bachelor's Student

Jordi Riemens
Bachelor's Student

Loes Erven
Bachelor's Student

Marvin Janssen
Bachelor's Student

Max Knechten
Bachelor's Student

Rory Quinn-Bailie
Bachelor's Student

Stef Brands
Bachelor's Student

Yousif Eldaw
Bachelor's Student


Collaborator


Prof. Isabelle Guyon

Prof. Marcel van Gerven

Prof. Pieter Roelfsema

Prof. Richard van Wezel

Prof. Rob van Lier

Prof. Sergio Escalera

Dr. Linda Geerligs

Dr. Luca Ambrogioni

Dr. Yağmur Güçlütürk

Publications


Preprint


  1. Dado, T., Papale, P., Lozano, A., Le, L., Wang, F., van Gerven, M., Roelfsema, P., Güçlütürk, Y., & Güçlü, U. (2023). Brain2GAN: Feature-disentangled neural coding of visual perception in the primate brain. bioRxiv 2023.04.26.537962. 🔗

  2. van der Grinten, M., de Ruyter van Steveninck, J., Lozano, A., Pijnacker, L., Rückauer, B., Roelfsema, P., van Gerven, M., van Wezel, R., Güçlü, U., & Güçlütürk, Y. (2022). Biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses. bioRxiv 2022.12.23.521749. 🔗

  3. Küçükoğlu, B., Borkent, W., Rueckauer, B., Ahmad, N., Güçlü, U., & van Gerven, M. (2022). Efficient Deep reinforcement learning with predictive processing proximal policy optimization. arXiv:2211.06236 [cs.LG]. 🔗

  4. Thielen, J., Güçlü, U., Güçlütürk, Y., Ambrogioni, L., Bosch, S., & van Gerven, M. (2019). DeepRF: Ultrafast population receptive field mapping with deep learning. bioRxiv 732990. 🔗

  5. Seeliger, K., Sommers, R., Güçlü, U., Bosch, S., & van Gerven, M. (2019). A large single-participant fMRI dataset for probing brain responses to naturalistic stimuli in space and time. bioRxiv 687681. 🔗


Journal


  1. Geerligs, L., Gözükara, D., Oetringer, D., Campbell, K., van Gerven, M., & Güçlü, U. (2022). A partially nested cortical hierarchy of neural states underlies event segmentation in the human brain. eLife, 11, e77430. 🔗

  2. Le, L., Ambrogioni, L., Seeliger, K., Güçlütürk, Y., van Gerven, M., & Güçlü, U. (2022). Brain2Pix: Fully convolutional naturalistic video frame reconstruction from brain activity. Frontiers in Neuroscience, 16, 940972. 🔗

  3. Küçükoğlu, B., Rueckauer, B., Ahmad, N., de Ruyter van Steveninck, J., Güçlü, U., & van Gerven, M. (2022). Optimization of neuroprosthetic vision via end-to-end deep reinforcement learning. International Journal of Neural Systems, 32(11), 2250052. 🔗

  4. Armeni, K., Güçlü, U., van Gerven, M., & Schoffelen, J. (2022). A 10-hour within-participant magnetoencephalography narrative dataset to test models of language comprehension. Scientific Data, 9, 278. 🔗

  5. de Ruyter van Steveninck, J., Güçlü, U., van Wezel, R., & van Gerven, M. (2022). End-to-end optimization of prosthetic vision. Journal of Vision, 22(2), 20. 🔗

  6. de Ruyter van Steveninck, J., van Gestel, T., Koenders, P., van der Ham, G., Vereecken, F., Güçlü, U., van Gerven, M., Güçlütürk, Y., & van Wezel, R. (2022). Real-world indoor mobility with simulated prosthetic vision: The benefits and feasibility of contour-based scene simplification at different phosphene resolutions. Journal of Vision, 22(2), 1. 🔗

  7. Dado, T., Güçlütürk, Y., Ambrogioni, L., Ras, G., Bosch, S., van Gerven, M., & Güçlü, U. (2022). Hyperrealistic neural decoding for reconstructing faces from fMRI activations via the GAN latent space. Scientific Reports, 12, 141. 🔗

  8. Geerligs, L., van Gerven, M., & Güçlü, U. (2021). Detecting neural state transitions underlying event segmentation. NeuroImage, 236, 118085. 🔗

  9. Seeliger, K., Ambrogioni, L., Güçlü, U., & van Gerven, M. (2021). End-to-end neural system identification with neural information flow. PLOS Computational Biology, 17(2), e1008558. 🔗

  10. Berezutskaya, J., Freudenburg, Z., Ambrogioni, L., Güçlü, U., van Gerven, M., & Ramsey, N. (2020). Cortical network responses map onto data-driven features that capture visual semantics of movie fragments. Scientific Reports, 10, 12077. 🔗

  11. Berezutskaya, J., Freudenburg, Z., Güçlü, U., van Gerven, M., & Ramsey, N. (2020). Brain-optimized extraction of complex sound features that drive continuous auditory perception. PLOS Computational Biology, 16(7), e1007992. 🔗

  12. Escalera, S., Escalante, H., Baró, X., Guyon, I., Madadi, M., Wan, J., Ayache, S., Güçlütürk, Y., & Güçlü, U. (2020). Guest editorial: Image and video inpainting and denoising. IEEE Transactions on Pattern Recognition and Machine Intelligence, 42(5), 1021-1024. 🔗

  13. Escalante, H., Kaya, H., Salah, A., Escalera, S., Güçlütürk, Y., Güçlü, U., Baró, X., Guyon, I., Junior, J., Madadi, M., Ayache, S., Viegas, E., Gürpınar, F., Wicaksana, A., Liem, C., van Gerven, M., & van Lier, R. (2020). Modeling, recognizing, and explaining apparent personality from videos. IEEE Transactions on Affective Computing, 13(2), 894-911. 🔗

  14. Junior, J., Güçlütürk, Y., Pérez, M., Güçlü, U., Andujar, C., Baró, X., Escalante, H., Guyon, I., van Gerven, M., van Lier, R., & Escalera, S. (2019). First impressions: A survey on vision-based apparent personality trait analysis. IEEE Transactions on Affective Computing, 13(1), 75-95. 🔗

  15. Seeliger, K., Güçlü, U., Ambrogioni, L., Güçlütürk, Y., & van Gerven, M. (2018). Generative adversarial networks for reconstructing natural images from brain activity. NeuroImage, 181, 775-785. 🔗

  16. Güçlütürk, Y., Güçlü, U., van Gerven, M., & van Lier, R. (2018). Representations of naturalistic stimulus complexity in early and associative visual and auditory cortices. Scientific Reports, 8, 3439. 🔗

  17. Seeliger, K., Fritsche, M., Güçlü, U., Schoenmakers, S., Schoffelen, J., Bosch, S., & van Gerven, M. (2017). Convolutional neural network-based encoding and decoding of visual object recognition in space and time. NeuroImage, 180(Part A), 253-266. 🔗

  18. Güçlütürk, Y., Güçlü, U., Baró, X., Escalante, H., Guyon, I., Escalera, S., van Gerven, M., & van Lier, R. (2017). Multimodal first impression analysis with deep residual networks. IEEE Transactions on Affective Computing, 9(3), 316-329. 🔗

  19. Berezutskaya, J., Freudenburg, Z., Güçlü, U., van Gerven, M., & Ramsey, N. (2017). Neural tuning to low-level features of speech throughout the perisylvian cortex. The Journal of Neuroscience, 37(33), 7906-7920. 🔗

  20. Güçlü, U., & van Gerven, M. (2017). Modeling the dynamics of human brain activity with recurrent neural networks. Frontiers in Computational Neuroscience, 11, 7. 🔗

  21. Güçlü, U., & van Gerven, M. (2015). Increasingly complex representations of natural movies across the dorsal stream are shared between subjects. NeuroImage, 145(Part B), 329-336. 🔗

  22. Güçlü, U., & van Gerven, M. (2015). Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream. The Journal of Neuroscience, 35(27), 10005-10014. 🔗

  23. Schoenmakers, S., Güçlü, U., van Gerven, M., & Heskes, T. (2015). Gaussian mixture models and semantic gating improve reconstructions from human brain activity. Frontiers in Computational Neuroscience, 8, 173. 🔗

  24. Güçlü, U., & van Gerven, M. (2014). Unsupervised feature learning improves prediction of human brain activity in response to natural images. PLOS Computational Biology, 10(8), e1003724. 🔗


Conference


  1. Gözükara, D., Oetringer, D., Geerligs, L., & Güçlü, U. (2023). Precision brain encoding under naturalistic conditions. Conference on Cognitive Computational Neuroscience. 🔗

  2. Le, L., Papale, P., Lozano, A., Dado, T., Wang, F., van Gerven, M., Roelfsema, P., Güçlütürk, Y., & Güçlü, U. (2023). End-to-end reconstruction of natural images from multi-unit recordings with Brain2Pix. Conference on Cognitive Computational Neuroscience. 🔗

  3. Dado, T., Papale, P., Lozano, A., Le, L., van Gerven, M., Roelfsema, P., Güçlütürk, Y., & Güçlü, U. (2023). Feature-disentangled reconstruction of perception from multi-unit recording. Conference on Cognitive Computational Neuroscience. 🔗

  4. Mahner, F., Muttenthaler, L., Güçlü, U., & Hebart, M. (2023). Dimensions that matter: Interpretable object dimensions in humans and deep neural networks. Conference on Cognitive Computational Neuroscience. 🔗

  5. Mahner, F., Seeliger, K., Güçlü, U., & Hebart, M. (2022). Learning cortical magnification with brain-optimized convolutional neural networks. Conference on Cognitive Computational Neuroscience. 🔗

  6. Dado, T., & Güçlü, U. (2021). Neural encoding with affine feature response transforms. International IEEE EMBS Conference on Neural Engineering. 🔗

  7. Dado, T., Güçlütürk, Y., Ambrogioni, L., Ras, G., Bosch, S., van Gerven, M., & Güçlü, U. (2021). Hyperrealistic neural decoding of faces. International IEEE EMBS Conference on Neural Engineering. 🔗

  8. Dallaire, P., Ambrogioni, L., Trottier, L., Güçlü, U., Hinne, M., Giguère, P., Chaib-Draa, B., van Gerven, M., & Laviolette, F. (2020). The Indian chefs process. Uncertainty in Artificial Intelligence. 🔗

  9. Seeliger, K., Ambrogioni, L., Güçlü, U., & van Gerven, M. (2019). Neural information flow: Learning neural information processing systems from brain activity. Conference on Cognitive Computational Neuroscience. 🔗

  10. Bokkers, L., Ambrogioni, L., & Güçlü, U. (2019). Segmentation of photovoltaic panels in aerial photography using group equivariant FCNs. Benelux Conference on Machine Learning. 🔗

  11. Ras, G., Ambrogioni, L., Güçlü, U., & van Gerven, M. (2019). Temporal factorization of 3D convolutional kernels. Benelux Conference on Machine Learning. 🔗

  12. Bollen, C., Güçlü, U., van Wezel, R., van Gerven, M., & Güçlütürk, Y. (2019). Simulating neuroprosthetic vision for emotion recognition. International Conference on Affective Computing and Intelligent Interaction Workshops. 🔗

  13. Ambrogioni, L., Güçlü, U., Berezutskaya, J., van den Borne, E., Güçlütürk, Y., Hinne, M., Maris, E., & van Gerven, M. (2019). Forward amortized inference for likelihood-free variational marginalization. International Conference on Artificial Intelligence and Statistics. 🔗

  14. Ambrogioni, L., Ebel, P., Hinne, M., Güçlü, U., van Gerven, M., & Maris, E. (2019). SpikeCaKe: Semi-analytic nonparametric Bayesian inference for spike-spike neuronal connectivity. International Conference on Artificial Intelligence and Statistics. 🔗

  15. Ambrogioni, L., Güçlü, U., Güçlütürk, Y., Hinne, M., van Gerven, M., & Maris, E. (2018). Wasserstein variational inference. Neural Information Processing Systems. 🔗

  16. Güçlütürk, Y., Güçlü, U., Seeliger, K., Bosch, S., van Lier, R., & van Gerven, M. (2017). Reconstructing perceived faces from brain activations with deep adversarial neural decoding. Neural Information Processing Systems. 🔗

  17. Ambrogioni, L., Berezutskaya, J., Güçlü, U., van den Borne, E., Güçlütürk, Y., van Gerven, M., & Maris, E. (2017). Bayesian model ensembling using meta-trained recurrent neural networks. Neural Information Processing Systems Workshops.

  18. Güçlü, U., Güçlütürk, Y., Ambrogioni, L., Maris, E., van Lier, R., & van Gerven, M. (2017). Algorithmic composition of polyphonic music with the WaveCRF. Neural Information Processing Systems Workshops. 🔗

  19. Güçlütürk, Y., Güçlü, U., Pérez, M., Escalante, H., Baró, X., Andujar, C., Guyon, I., Junior, J., Madadi, M., Escalera, S., Van Gerven, M., & Van Lier, R. (2017). Visualizing apparent personality analysis with deep residual networks. International Conference on Computer Vision Workshops. 🔗

  20. Berezutskaya, J., Freudenburg, Z., Ramsey, N., Güçlü, U., & van Gerven, M. (2017). Modeling brain responses to perceived speech with LSTM networks. Benelux Conference on Machine Learning. 🔗

  21. Escalante, H., Guyon, I., Escalera, S., Junior, J., Madadi, M., Baró, X., Ayache, S., Viegas, E., Güçlütürk, Y., Güçlü, U., van Gerven, M., & van Lier, R. (2017). Design of an explainable machine learning challenge for video interviews. International Joint Conference on Neural Networks. 🔗

  22. Güçlü, U., Thielen, J., Hanke, M., & van Gerven, M. (2016). Brains on beats. Neural Information Processing Systems. 🔗

  23. Güçlütürk, Y., Güçlü, U., van Lier, R., & van Gerven, M. (2016). Convolutional sketch inversion. European Conference on Computer Vision Workshops. 🔗

  24. Güçlütürk, Y., Güçlü, U., van Gerven, M., & van Lier, R. (2016). Deep impression: Audiovisual deep residual networks for multimodal apparent personality trait recognition. European Conference on Computer Vision Workshops. 🔗

  25. Güçlü, U., & van Gerven, M. (2015). Semantic vector space models predict neural responses to complex visual stimuli. Neural Information Processing Systems Workshops. 🔗

  26. Güçlü, U., & van Gerven, M. (2013). Unsupervised learning of features for Bayesian decoding in functional magnetic resonance imaging. Benelux Conference on Machine Learning. 🔗

  27. Güçlütürk, Y., Güçlü, U., & Samraj, A. (2010). An online single trial analysis of the P300 event related potential for the disabled. Convention of Electrical and Electronics Engineers in Israel. 🔗

  28. Güçlü, U., Güçlütürk, Y., & Loo, C. (2010). Evaluation of fractal dimension estimation methods for feature extraction in motor imagery based brain computer interface. World Conference on Information Technology. 🔗

  29. Güçlü, U., Güçlütürk, Y., & Samraj, A. (2010). A novel approach to improve the performance of the P300 speller paradigm. International Conference on Systems, Man and Cybernetics. 🔗


Chapter


  1. van Gerven, M., Seeliger, K., Güçlü, U., & Güçlütürk, Y. (2019). Current advances in neural decoding. In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning (pp. 379-394). Springer. 🔗

  2. Güçlü, U., & van Gerven, M. (2017). Probing human brain function with artificial neural networks. In Computational Models of Brain and Behavior (pp. 413-423). Wiley. 🔗


Book


  1. Escalera, S., Ayache, S., Wan, J., Madadi, M., Güçlü, U., & Baró, X. (2019). Inpainting and Denoising Challenges. Springer. 🔗

  2. Escalante, H., Escalera, S., Guyon, I., Baró, X., Güçlütürk, Y., Güçlü, U., & van Gerven, M. (2019). Explainable and Interpretable Models in Computer Vision and Machine Learning. Springer. 🔗

  3. Güçlü, U. (2018). Neural coding with deep learning [Doctoral Thesis, Radboud University]. 🔗


Archive


  1. Ras, G., Ambrogioni, L., Haselager, P., van Gerven, M., & Güçlü, U. (2020). Explainable 3D convolutional neural networks by learning temporal transformations. arXiv:2006.15983 [cs.CV]. 🔗

  2. Ras, G., Dotsch, R., Ambrogioni, L., Güçlü, U., & van Gerven, M. (2019). Background hardly matters: Understanding personality attribution in deep residual networks. arXiv:1912.09831 [cs.LG]. 🔗

  3. Ambrogioni, L., Güçlü, U., & van Gerven, M. (2019). k-GANs: Ensemble of generative models with semi-discrete optimal transport. arXiv:1907.04050 [stat.ML]. 🔗

  4. Ambrogioni, L., Güçlü, U., Güçlütürk, Y., & van Gerven, M. (2018). Wasserstein variational gradient descent: From semi-discrete optimal transport to ensemble variational inference. arXiv:1811.02827 [stat.ML]. 🔗

  5. Ambrogioni, L., Güçlü, U., van Gerven, M., & Maris, E. (2017). The kernel mixture network: A nonparametric method for conditional density estimation of continuous random variables. arXiv:1705.07111 [stat.ML]. 🔗

  6. Güçlü, U., Güçlütürk, Y., Madadi, M., Escalera, S., Baró, X., González, J., van Lier, R., & van Gerven, M. (2017). End-to-end semantic face segmentation with conditional random fields as convolutional, recurrent and adversarial networks. arXiv:1703.03305 [cs.CV]. 🔗

  7. Ambrogioni, L., Güçlü, U., Maris, E., & van Gerven, M. (2017). Estimating nonlinear dynamics with the ConvNet smoother. arXiv:1702.05243 [stat.ML]. 🔗