See the backslashes are 'escape' characters in R strings. Say for instance, linefeeds are "\n" and tabs are "\t". So to have a real backslash you have to escape the escape character. To indicate the two-character string \N use the string "\\N". So to your code,
library(tidyverse)
airports_m %>%
filter(IATA != "\\N")
Or just in case there's some other trash on the line
airports_m %>%
filter(! str_detect(IATA , "\\N"))
If you are a beginner and want to know more about R then do check out the R programming course.