Nonminimally coupling matter to curvature: from inflation to gravitational waves and non-metricity