You write:
One planet is pretty much a perfect copy of Earth and the other planet is 20% less massive with a radius 10% smaller.
So the smaller planet has 0.90 of the radius of Earth and 0.80 of the mass of Earth.
A planet with 0.9 the radius of Earth should have a volume of 0.729 the volume of Earth. If its average density was equal to that of Earth, it would have a mass of 0.729 Earth.
A planet with 0.8 the mass of Earth should have a volume of 0.8 Earth if it has the same denisty as Earth. My rough calculations indicate that a planet with a radius of 0.925 that of Earth would have a volume of 0.791453 Earth, and thus a mass of 0.791453 Earth if it has the same density as Earth.
For two planets with the same ratio of elements in their composition, the more massive planet will have a larger overall density, because its greater gravity will compress materials more.
You want a planet less massive than Earth to be a bit more dense than Earth. That can be done by increasing the proportion of denser, heavier, elements in the composition of the planet. But is the extra proportion of denser elments necessary for that overall density plausible? I don't know, I am not an expert on planetary formation.
So if the two planets formed at the same distance from their star, why would the larger planet, with almost identical mass and radius as Earth, have a lower density than the smaller planet?
Possibly the two planets formed at different distances from their star, and early processes of planetary orbital migration caused their orbits to approach and they eventually captured each other and became a double planet. Of course that seems to be a statisically very improbable event, so maybe you should adjust your figures so that the smaller planet has a similar but lesser density than the larger planet.
As I remember, Habitable Planets for Man, stephen H. Dole, 1964, has a table and possibly a formula for calculated the radius and density of an Earth like planet of a specified mass.
https://www.rand.org/content/dam/rand/pubs/commercial_books/2007/RAND_CB179-1.pdf[1]
And it gives a formula for the average density of a rocky planet calculated from its average surface density and its radius. And of course multiplying the average density of a planet by its volume (calculated from its radius) will give its mass. And there is also a figure on page 30s howing the relationship between the radius of a planet relative to Earth and the planet's average density.
Of course today there are now more precise values known for the masses of Venus and Mercury, and the Dwarf planet Ceres. There are also rather precise values known for the masses, radii, and average densities of the larger moons of Jupiter, saturn, Uranus, and Neptune, but those bodies are likely to be partially made of ice, and so should have much lower densities than the the Earth-like objects in the solar system.
The separation of the two planets at 1,000,000 kilometers.
The Hill sphere or Roche sphere of an astronomical body is the region in which it dominates the attraction of satellites. The outer shell of that region constitutes a zero-velocity surface. To be retained by a planet, a moon must have an orbit that lies within the planet's Hill sphere. That moon would, in turn, have a Hill sphere of its own. Any object within that distance would tend to become a satellite of the moon, rather than of the planet itself. One simple view of the extent of the Solar System is the Hill sphere of the Sun with respect to local stars and the galactic nucleus.1
In the Earth-Sun example, the Earth (5.97×1024 kg) orbits the Sun (1.99×1030 kg) at a distance of 149.6 million km, or one astronomical unit (AU). The Hill sphere for Earth thus extends out to about 1.5 million km (0.01 AU). The Moon's orbit, at a distance of 0.384 million km from Earth, is comfortably within the gravitational sphere of influence of Earth and it is therefore not at risk of being pulled into an independent orbit around the Sun. All stable satellites of the Earth (those within the Earth's Hill sphere) must have an orbital period shorter than seven months.
https://en.wikipedia.org/wiki/Hill_sphere[2]
The Hill sphere is only an approximation, and other forces (such as radiation pressure or the Yarkovsky effect) can eventually perturb an object out of the sphere. This third object should also be of small enough mass that it introduces no additional complications through its own gravity. Detailed numerical calculations show that orbits at or just within the Hill sphere are not stable in the long term; it appears that stable satellite orbits exist only inside 1/2 to 1/3 of the Hill radius. The region of stability for retrograde orbits at a large distance from the primary is larger than the region for prograde orbits at a large distance from the primary. This was thought to explain the preponderance of retrograde moons around Jupiter; however, Saturn has a more even mix of retrograde/prograde moons so the reasons are more complicated.3
https://en.wikipedia.org/wiki/Hill_sphere#True_region_of_stability[3]
So the Earth's true region of stability for satellite orbits only extends to about 500,000 or 750,000 kilometers. Thus it seems unlikely that two Earth like planets with a total mass of less than two times that of the Earth could have stable orbits around each other at a distance of 1,000,000 kilometers.