Was there a prominent reason that made Immigrants not want to come to America during the Civil War?

Looking throughout history, following what past immigrants have decided, has been able to lead me through an amazing historical journey. I saw that all immigrants chose immigration for multiple reasons and some of the main reasons was that one country was doing better economically than their own or relatives that had emigrated before chose to share stories of greater wealth or adventure in the place they emigrated to. In America I saw how the growth in our economy reflected upon the growth in immigration and vice versa. The times during war, showed how even though it was a opportunistic time for immigrants, the risks outweighed the advantages and immigration reached all-time lows after the beginning of major wars, especially internally (Civil War). When the Civil War was becoming more apparent and inevitable, the economy was slowing down, and with it the incoming immigrants, possibly because of the fear of being drafted depending on how the war was going. As the war developed it became apparent how it was possible for any immigrants to be drafted towards the end of the war if it prolonged for more than the 5 years it took to become a citizen. With this in mind it caused a lot more awareness of the risks and in the reduction of immigrants during the wartime.