Hydrogen embrittlement is a well-known problem with high-strength steels. An important aspect of hydrogen embrittlement research is the effect of the prior austenite grain (PAG) structure on hydrogen-induced fracture. The microstructural anisotropy of PAG structure depends on the steel manufacturing process. In this study, 500 HBW martensitic steels with different PAG structures are investigated with a novel tuning-fork test that utilizes an integrated loadcell system. The loadcell clamping system is used during hydrogen charging, allowing tracking of the applied force throughout the tests, which enables detection of separate phases of cracking and time-to-fracture. The elongated PAG morphology produces different results depending on the crack path direction in relation to the rolling direction, whereas the equiaxed PAG morphology does not manifest an orientation dependence. Depending on the PAG shape, also the fracture morphology differs. Time-to-fracture results show that elongated grain morphologies with transgranular quasi-cleavage crack propagation are more beneficial against hydrogen-induced fracture than equiaxed grain structure with intergranular crack propagation. These results demonstrate that the shape of the PAG structure plays an important role in the crack propagation mechanism and that it is important to consider the possible direction of hydrogen-induced cracks in the final structural applications.