in
History
—
Victory and a Vicious Lie: The Day Outnumbered Black Soldiers Defeated Lee's Nephew at Wilson's Wharf
At Wilson's Wharf in 1864, outnumbered U.S. Colored Troops decisively defeated a Confederate force led by Robert E. Lee's nephew. The Confederate commander, unable to accept defeat by black soldiers, falsely reported being overwhelmed by Union gunboats that were not actually there.
In the bloody spring of 1864, as the Civil War raged across Virginia, a small but pivotal battle unfolded on the banks of the James River. It was a confrontation that would not only test the mettle of a new fighting force but also expose the deep-seated prejudices that fueled the Confederacy. At Wilson's Wharf, United States Colored Troops (USCT) faced their first major combat test against Confederate forces, who were led by none other than Robert E. Lee’s nephew. The result was a stunning Union victory and a subsequent lie crafted to hide a humiliating truth: that black soldiers, whom the Confederates deemed inferior, had bested them in battle.
The Garrison at Wilson's Wharf
By May 1864, the Union had established a supply depot at Wilson's Wharf to support Ulysses S. Grant's Overland Campaign. Protecting this vital position was a garrison of approximately 1,100 men commanded by Brigadier General Edward A. Wild. The force consisted of the 1st and 10th U.S. Colored Troops, along with a small artillery battery. For these men, many of whom were former slaves, this was more than just a military assignment; it was a chance to fight for their own freedom and prove their worth as soldiers in a nation that had for so long denied them their humanity.
An Attack Fueled by Prejudice
On May 24, Major General Fitzhugh Lee, a respected cavalry commander and nephew of the Confederate general-in-chief, arrived with a force of 2,500 men. Believing the black soldiers would break and run, Lee anticipated a swift and easy victory. The memory of the Fort Pillow Massacre, which had occurred just a month prior, loomed large. Confederate policy was often to refuse quarter to black soldiers, and Lee's initial demand for surrender carried an implicit, violent threat. He sent a message to General Wild demanding he surrender, promising the white officers would be taken to Richmond as prisoners of war, while the black soldiers would be turned over to their “masters.” General Wild, an ardent abolitionist who had lost an arm at the Battle of South Mountain, was incensed. His official written reply was short and defiant.
We will try it.
Wild reportedly added a verbal message for the Confederate courier to take back to his commander: “Tell General Fitz Lee to go to hell.” The battle lines were drawn not just in the dirt, but in ideology.
A Resounding Defeat
Fitzhugh Lee ordered his men to attack the Union earthworks. The Confederates, confident in their numerical superiority, charged forward. They were met with disciplined and withering volleys of rifle fire from the USCT soldiers. The men of the 1st and 10th regiments held their ground, repulsing multiple Confederate assaults with courage and determination. The Union gunboat USS Dawn provided some supporting fire from the river, but the fight was won on the ground by the infantrymen who refused to yield. By late afternoon, having suffered heavy casualties and failing to breach the defenses, a frustrated and beaten Fitzhugh Lee ordered a retreat. The Union victory was decisive: the Confederates suffered nearly 200 casualties, while the Union garrison lost only 26.
A General's Lie to Hide the Shame
For Fitzhugh Lee, the defeat was not just a tactical failure; it was a deep personal and ideological embarrassment. To admit being soundly beaten by a smaller force of black soldiers was unthinkable in the Confederate mindset. It would shatter the myth of racial superiority that underpinned their entire society. So, he lied. In his official report, Lee concocted a story to explain his failure. He claimed his men had faced an overwhelming force supported by a “strong fleet of gun-boats.” In reality, only the single, small USS Dawn was present. Lee chose to invent a phantom fleet rather than acknowledge the skill and bravery of the African American soldiers who had defeated him. The Battle of Wilson’s Wharf was a testament to the fact that courage is not determined by the color of one’s skin, and that the fight for freedom could forge some of the Union's finest soldiers.