If we will use list with concatenation, then it will work fine.
Declaring all_data as a list.
all_data = [] for f in glob.glob("output/test/*.xlsx"):
all_data.append(pd.read_excel(f))
Now, concatenate all_data.
df = pd.concat(all_data, ignore_index=True)
If you wish to learn about Python visit this Python Course.