GitHub not working in Visual Studio Code on Linux but works on Command Line

On Ubuntu 18.04. When I try to use GitHub within Visual Studio Code, it says Git: git@github.com: Permission denied (publickey):

Problem

However, everything works well when I use git / GitHub from the Terminal. I have put some SSH keys into GitHub already, and that's why it works from the command line.

What might be the problem?