Don't take this as gospel, as it is just info I have gleaned off of the internet and this Forum, specifically. I do not vouch for it. But, your family is listed in my files as follows. Note that the father of John is a William Lee, not Richard, and that there is a Milly in the missing generation that perhaps your Milly is named after. Ignore the "Impossible" and other tags - they're just my notes to myself about my John Lee. Also, the "-1" and "0" were afterthoughts - I got some information and never got around to rejustifying the various succeeding generations.
-1. William Lee
possibly of James City Co, VA
0. William Lee
possibly of Charles City Co, VA
m. Catherine?
1. William Lea/Leigh (Col.)
m. Mary Green
2. William Lee
m. Frances Major
"of K&Q and New Kent counties"
2. John Lea/Leigh (Maj.)
m. Ann Taylor
3. William Lea/Lee, Sr.
of Amelia Co, VA (Nottoway Parish), now Caroline Co, VA
possibly s/o William Lee, brother of John
b. ca 1700, Spotsylvania, King and Queen Co, VA
d. 17 Jun 1770, Amelia Co, VA (Bk. 34 pg 328)
m. Rachel Ambrose
4. John Lee VERY UNLIKELY
b. ca 1755
d. 1783, Charlotte Co, VA; will proved 6 Jan 1783.
m. unmarried; will leaves belongings to his siblings
resided Amelia and Charlotte Counties, VA
4. Mary Lee
m1. Simon Walden / Waldon
m2. George Penn
m1. Sarah Lee, Mary's sister
4. Sarah Lee
b. ca 1740
m. George Penn
m2. Mary Lee, Sarah's sister
4. Ambrose Lee
b. ca 1732
d. Oct 1764, Amherst Co, VA
m. Frances Penn (brother of George, d/o George Penn and Ann)
5. George Lee/Lea
b. 1750
m. Elizabeth Shelton, 14 Feb 1772 or 21 Jan 1772, Amherst Co, VA
b. 20 Mar 1754 VA
d. 8 Jun 1817 KY
d/o David Shelton & Elizabeth Winston
d. 1825, Lincoln Co, KY
6. Ambrose Lee
b. 3 Jan 1773
m. Hannah Blain
6. Ralph Lee
m. Elizabeth Doyle
7. John Doyle Lee
b. 6 Sep 1812, Kaskaskia, Randolph Co, IL
d. UT
6 wives
6. Permelia/Pamelia Lee
b. 27 Nov 1774
m. John Welsh
6. Richard Henry Lee
b. ca 1776
m. Martha Montgomery
6. Mary Wright Lee
b. ca 1779
m. Thomas Montgomery
6. Lewis Lee
b. 15 Apr 1781
6. John Lee IMPOSSIBLE
b. 1783
d. Amherst Co, VA
6. William Fleming Lee
b. ca 1785
m. Jane Smith
6. Abram Penn Lee
b. 24 Jan 1788
m. Elizabeth Crutcher
6. George Lee, Jr.
b. ca 1790
m. Mary Shelton
7. J.E. Lee
b. 1825
m. Elizabeth Miller
6. Francis Lightfoot Lee
b. ca 1792
m. Sophia Thomson
4. Elizabeth Lee
m. Benjamin Clark / Clarke
4. Ann Lee
b. ca 1742
m. Richard Bennett
moved to NC
4. Milly Lee
b. ca 1750
m. Thomas Dudley
4. Lucy Lee
b. ca 1752
m. Marsten Green
4. William Lee
b. ca 1749
b. 1785, Amherst Co, VA
m. Susanna / Susannah Dawson
Revolutionary War patriot, per DAR Patriot Index, PS VA.
4. Joseph Lee
b. ca 1744
d. NC
m. Molly Knight
4. Andrew Lee
b. ca 1748
m. Elizabeth Dudley