Brendon McCullum and Martin Guptill put on a 123-run partnership to help New Zealand end the fourth day of the first Test on 199 for three, on Saturday, but two late wickets will give the West Indies hope of securing a victory.
After the hosts built a 171-run first innings lead in Antigua, with skipper Darren Sammy (50) and Narsingh Deonarine (79) ensuring they reached 522, the tourists needed to show plenty of resolve to save the Test.
Guptill (67) and Daniel Flynn put on 47 for the first wicket before Sunil Narine, who grabbed a five-wicket haul in the first innings, trapped the latter on the back foot lbw for 20.
Despite the wicket, New Zealand knuckled down with McCullum (84) and Guptill batting sensibly, exercising caution against Narine's spin as they looked to see the visitors through to the close of play without any more alarms.
However, Narine struck again, coming around the wicket and getting some bounce with a ball that struck Guptill's glove and was snapped up by Assad Fudadin at short leg.
The momentum shifted further towards the West Indies when McCullum, looking well set for a century, played on with an inside edge from Kemar Roach.
A lead of 28 runs with seven second innings wickets remaining ahead of Sunday's final day will require some disciplined batting from New Zealand against a West Indies attack that can sense victory.
New Zealand (1st innings): 351
West Indies (1st innings): (overnight 442-6)
C.Gayle c McCullum b Williamson 150
K.Powell c Van Wyk b Wagner 134
A.Fudadin c McCullum b Williamson 55
M.Samuels b Martin 28
S.Chanderpaul c Van Wyk b Martin 0
N.Deonarine b Martin 79
D.Ramdin b Bracewell 3
D.Sammy c & b Vettori 50
S.Narine run out 4
K.Roach not out 6
R.Rampaul lbw b Bracewell 1
Extras: (lb-9, nb-3) 12
Total: (all out, 163 overs) 522
Fall of wickets: 1-252, 2-304, 3-355, 4-355, 5-410, 6-428, 7-497, 8-502, 9-516, 10-522.
Bowling: Martin 30-9-134-3 (nb-3), Bracewell 29.3-5-96-2, Wagner 33-8-112-1, Vettori 51-14-124-1, Williamson 20-2-47-2.
New Zealand (2nd innings):
M.Guptill c Fudadin b Narine 67
D.Flynn lbw b Narine 20
B.McCullum b Roach 84
R.Taylor not out 11
N.Wagner not out 4
Extras: (b-3, lb-7, nb-3) 13
Total: (three wickets, 64 overs) 199
Fall of wickets: 1-47, 2-170, 3-194
Bowling: Rampaul 6-0-25-0, Roach 13-1-44-1 (nb-3), Narine 26-5-67-2, Sammy 12-3-24-0, Samuels 3-1-22-0, Deonarine 4-2-7-0.