that time是状语还是定语

I hit the man in the ear. He screamed with pain. He was small, but a tough son-of-a-gun. I stepped back, and hit him hard in the stomach. Oh my God! he moaned. I think I hurt him that time.关于这里的that time是限定词加名词是作状语成分吗？

that time （那次），this time （这次），都是常见的时间状语（其构成是网友所说的“限定词加名词”），当然作状语成分。