The invention discloses a compaction-type sand gravel filling device and a construction method. The compaction-type sand gravel filling device comprises two tracks, an adjustment device, a traction rope, a traction device and a sand gravel filling box. The adjustment device comprises an adjustment frame, a rotary rod and an adjustment rod. The sand gravel filling box comprises a first mounting support, a second mounting support, a feeding part, a buffering part and a discharging part. The construction method comprises the steps of a, digging of a sand gravel filling pit; b, arrangement of thetracks; c, arrangement of the adjustment device; d, arrangement of the traction device; e, hoisting and placing of the sand gravel filling box; f, sand gravel filling; g, repeating of the step e and the step f; and h, compaction of a sand gravel layer. By adoption of the compaction-type sand gravel filling device and the construction method, the sand gravel filling pit can be orderly filled with sand gravels in one direction, so that the structure of the sand gravel filling pit is prevented from being damaged; the construction difficulty is lowered, and the construction quality of an ecological retaining wall is improved; and meanwhile, the sand gravel layer can be laid rapidly by only one person, so that the labor cost is reduced, and the construction process of the whole ecological retaining wall is shortened.