『MXNet』第六弹_数据处理API(待续)
发布时间:2020-12-14 04:49:39 所属栏目:大数据 来源:网络整理
导读:一、Gluon数据加载 图片数据(含标签)加载函数:gluon.data.vision.ImageFolderDataset 给出ImageFolderDataset类的描述, Init signature: mxnet.gluon.data.vision.datasets.ImageFolderDataset(root,flag=1,transform=None)Source: class ImageFolderDatas
一、Gluon数据加载图片数据(含标签)加载函数:gluon.data.vision.ImageFolderDataset给出ImageFolderDataset类的描述, Init signature: mxnet.gluon.data.vision.datasets.ImageFolderDataset(root,flag=1,transform=None) Source: class ImageFolderDataset(dataset.Dataset): """A dataset for loading image files stored in a folder structure like:: root/car/0001.jpg root/car/xxxa.jpg root/car/yyyb.jpg root/bus/123.jpg root/bus/023.jpg root/bus/wwww.jpg Parameters ---------- root : str Path to root directory. flag : {0,1},default 1 # 控制彩色or灰度 If 0,always convert loaded images to greyscale (1 channel). If 1,always convert loaded images to colored (3 channels). transform : callable,default None A function that takes data and label and transforms them: :: transform = lambda data,label: (data.astype(np.float32)/255,label) Attributes ---------- synsets : list # 查看类别,实际就是文件名 List of class names. `synsets[i]` is the name for the integer label `i` items : list of tuples # 生成的数据 List of all images in (filename,label) pairs. """ 实例: train_imgs = gluon.data.vision.ImageFolderDataset( data_dir+‘/hotdog/train‘,transform=lambda X,y: transform(X,y,train_augs)) test_imgs = gluon.data.vision.ImageFolderDataset( data_dir+‘/hotdog/test‘,test_augs)) print(train_imgs) print(train_imgs.synsets) data = gluon.data.DataLoader(train_imgs,32,shuffle=True) <mxnet.gluon.data.vision.datasets.ImageFolderDataset object at 0x7fbed5641c18> [‘hotdog‘,‘not-hotdog‘] batch迭代器:gluon.data.DataLoader具有特殊方法,def __iter__(self),其实例可以被迭代,也就是每次返回一个batch的数据,在第一维度上切割。 首个定位参数文档如下: dataset : Dataset Source dataset. Note that numpy and mxnet arrays can be directly used as a Dataset. 最后生成的X_batch送入net(X_batch)向前传播,y_batch送入loss(output,y_batch)计算loss后反向传播。 二、MXNet数据加载?https://blog.csdn.net/qq_36165459/article/details/78394322 https://blog.csdn.net/u012759136/article/details/50208733#%E4%BA%8C%E4%BB%8E%E5%8E%9F%E7%94%9F%E6%95%B0%E6%8D%AE%E7%94%9F%E6%88%90lst%E6%96%87%E4%BB%B6 (编辑:李大同) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |