Step 1

Toss chicken thighs, lemon slices, fennel seeds, 4 rosemary sprigs, and 2½ tsp. salt in a large bowl to combine, then season generously with pepper. Cover and chill at least 12 hours and up to 1 day.

Step 2

Let chicken come to room temperature, 20–25 minutes.

Step 3

Place racks in top and middle of oven; preheat to 275°. Arrange potatoes and onions in a large Dutch oven or other heavy pot and season with salt. Transfer chicken mixture to pot, scraping in any stray fennel seeds, and arrange chicken thighs, skin side up, over potatoes and onions in a single layer (it will be a tight squeeze). Pour in 4 cups oil. It should come to just over the top of the chicken; if the pieces aren’t quite submerged, add the additional ½ cup oil. Cover pot and place on middle rack in oven. Bake chicken, adding remaining rosemary sprigs after 1 hour, until meat is very tender but not quite falling off the bone, 2–2½ hours. Let sit until pot is cool enough to handle, 25–30 minutes.

Step 4

Meanwhile, heat broiler. Use tongs to carefully remove chicken from pot and place, skin side up, on a rimmed baking sheet. Transfer potatoes to baking sheet, arranging around chicken. Broil until chicken skin and potatoes are browned and crisp, about 5 minutes. Let rest 5–10 minutes on baking sheet.

Step 5

While chicken and potatoes are under the broiler, transfer onions, lemon slices, and rosemary to a platter. Strain oil through a fine-mesh sieve into a large measuring glass.

Step 6

Use a fork to lightly smash potatoes, revealing some of their creamy interior. Season with more salt. Transfer chicken and potatoes to platter with reserved onions, lemon slices, and rosemary sprigs. Drizzle with some of the strained oil (save the rest for another use).

Step 7

Do Ahead: Chicken can be baked (but not broiled) 2 days ahead. Let cool in oil, then chill.