我有一个包含10000张图像的文件夹,以及3个子文件夹,每个文件夹包含不同数量的图像。我想导入这些图像的一小部分进行训练,每次我要选择部分数据时,我都会手动选择有限的大小。 我已经有了这个python代码:
train_dir = 'folder/train/' # This folder contains 10.000 images and 3 subfolders , each folder contains different number of images
from tqdm import tqdm
def get_data(folder):
"""
Load the data and labels from the given folder.
"""
X = []
y = []
for folderName in os.listdir(folder):
if not folderName.startswith('.'):
if folderName in ['Name1']:
label = 0
elif folderName in ['Name2']:
label = 1
elif folderName in ['Name3']:
label = 2
else:
label = 4
for image_filename in tqdm(os.listdir(folder + folderName)):
img_file = cv2.imread(folder + folderName + '/' + image_filename)
if img_file is not None:
img_file = skimage.transform.resize(img_file, (imageSize, imageSize, 1))
img_arr = np.asarray(img_file)
X.append(img_arr)
y.append(label)
X = np.asarray(X) # Keras only accepts data as numpy arrays
y = np.asarray(y)
return X,y
X_test, y_test= get_data(train_dir)
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X_test, y_test, test_size=0.2)
我想指定Size
参数,以便我可以选择要导入的图像数量。从每个子文件夹导入的图像数量应相等
答案 0 :(得分:1)
您可以读取每个文件夹中的每个路径并将其存储在单独的列表中,并选择相等数量的路径。
folder1_files = []
for root, dirs, files in os.walk('path/folder1', topdown=False):
for i in files:
folder1_files.append("path/folder1/"+i)
选择:
train = folder1[:n] + folder2[:n] + folder3[:n]
n-每个文件夹中的图像数量