As I am trying to learn csharp and testing visual studio I see that upon build I see a bunch of files getting created in the bin folder not just the executable. There are also .dlls and .pak, .xml, .pdb, .log, .dat, etc.
Visual Studio is a very powerful programming tool developed over decades by developers for developers, with considerable input from the global developer community. Much of it’s power comes from "the “bunch of files” you mention. After you become familiar with the capabilities you need and discover the ones you find useful that you may not have even thought existed you will be in a position to answer your own question, and actually you are the only one who can answer it. As you gain familiarity with the various features you can discover which files you need and which you can delete. In the meantime, just leave them be.
I should also mention that many of them are transient; they come and go with each re-compile.
In that case you can always just first copy your own DLLs to a new folder, then one by one dlls and other files that look important until your plug-in starts loading and functioning in Rhino
Anyway, from nugets you probably get DLLs that you need, probably nothing else needed. But that is just a guess