663
阿裏雲
兼容版本SDK介紹__Java SDK介紹_MapReduce_大數據計算服務-阿裏雲
我們將在下表中給出MaxCompute兼容版本的MapReduce與Hadoop MapReduce兼容性的詳細列表。
| 類型 | 接口 | 是否兼容 |
|---|---|---|
| Mapper | void map(KEYIN key, VALUEIN value, org.apache.hadoop.mapreduce.Mapper.Context context) | 是 |
| Mapper | void run(org.apache.hadoop.mapreduce.Mapper.Context context) | 是 |
| Mapper | void setup(org.apache.hadoop.mapreduce.Mapper.Context context) | 是 |
| Reducer | void cleanup(org.apache.hadoop.mapreduce.Reducer.Context context) | 是 |
| Reducer | void reduce(KEYIN key, VALUEIN value, org.apache.hadoop.mapreduce.Reducer.Context context) | 是 |
| Reducer | void run(org.apache.hadoop.mapreduce.Reducer.Context context) | 是 |
| Reducer | void setup(org.apache.hadoop.mapreduce.Reducer.Context context) | 是 |
| Partitioner | int getPartition(KEY key, VALUE value, int numPartitions) | 是 |
| MapContext（繼承TaskInputOutputContext） | InputSplit getInputSplit() | 否，拋異常 |
| ReduceContext | nextKey() | 是 |
| ReduceContext | getValues() | 是 |
| TaskInputOutputContext | getCurrentKey() | 是 |
| TaskInputOutputContext | getCurrentValue() | 是 |
| TaskInputOutputContext | getOutputCommitter() | 否，拋異常 |
| TaskInputOutputContext | nextKeyValue() | 是 |
| TaskInputOutputContext | write(KEYOUT key, VALUEOUT value) | 是 |
| TaskAttemptContext | getCounter(Enum<?> counterName) | 是 |
| TaskAttemptContext | getCounter(String groupName, String counterName) | 是 |
| TaskAttemptContext | setStatus(String msg) | 空實現 |
| TaskAttemptContext | getStatus() | 空實現 |
| TaskAttemptContext | getTaskAttemptID() | 否，拋異常 |
| TaskAttemptContext | getProgress() | 否，拋異常 |
| TaskAttemptContext | progress() | 是 |
| Job | addArchiveToClassPath(Path archive) | 否 |
| Job | addCacheArchive(URI uri) | 否 |
| Job | addCacheFile(URI uri) | 否 |
| Job | addFileToClassPath(Path file) | 否 |
| Job | cleanupProgress() | 否 |
| Job | createSymlink() | 否，拋異常 |
| Job | failTask(TaskAttemptID taskId) | 否 |
| Job | getCompletionPollInterval(Configuration conf) | 空實現 |
| Job | getCounters() | 是 |
| Job | getFinishTime() | 是 |
| Job | getHistoryUrl() | 是 |
| Job | getInstance() | 是 |
| Job | getInstance(Cluster ignored) | 是 |
| Job | getInstance(Cluster ignored, Configuration conf) | 是 |
| Job | getInstance(Configuration conf) | 是 |
| Job | getInstance(Configuration conf, String jobName) | 空實現 |
| Job | getInstance(JobStatus status, Configuration conf) | 否，拋異常 |
| Job | getJobFile() | 否，拋異常 |
| Job | getJobName() | 空實現 |
| Job | getJobState() | 否，拋異常 |
| Job | getPriority() | 否，拋異常 |
| Job | getProgressPollInterval(Configuration conf) | 空實現 |
| Job | getReservationId() | 否，拋異常 |
| Job | getSchedulingInfo() | 否，拋異常 |
| Job | getStartTime() | 是 |
| Job | getStatus() | 否，拋異常 |
| Job | getTaskCompletionEvents(int startFrom) | 否，拋異常 |
| Job | getTaskCompletionEvents(int startFrom, int numEvents) | 否，拋異常 |
| Job | getTaskDiagnostics(TaskAttemptID taskid) | 否，拋異常 |
| Job | getTaskOutputFilter(Configuration conf) | 否，拋異常 |
| Job | getTaskReports(TaskType type) | 否，拋異常 |
| Job | getTrackingURL() | 是 |
| Job | isComplete() | 是 |
| Job | isRetired() | 否，拋異常 |
| Job | isSuccessful() | 是 |
| Job | isUber() | 空實現 |
| Job | killJob() 是 | |
| Job | killTask(TaskAttemptID taskId) | 否 |
| Job | mapProgress() | 是 |
| Job | monitorAndPrintJob() | 是 |
| Job | reduceProgress() | 是 |
| Job | setCacheArchives(URI[] archives) | 否，拋異常 |
| Job | setCacheFiles(URI[] files) | 否，拋異常 |
| Job | setCancelDelegationTokenUponJobCompletion(boolean value) | 否，拋異常 |
| Job | setCombinerClass(Class<? extends Reducer> cls) | 是 |
| Job | setCombinerKeyGroupingComparatorClass(Class<? extends RawComparator> cls) | 是 |
| Job | setGroupingComparatorClass(Class<? extends RawComparator> cls) | 是 |
| Job | setInputFormatClass(Class<? extends InputFormat> cls) | 空實現 |
| Job | setJar(String jar) | 是 |
| Job | setJarByClass(Class<?> cls) | 是 |
| Job | setJobName(String name) | 空實現 |
| Job | setJobSetupCleanupNeeded(boolean needed) | 空實現 |
| Job | setMapOutputKeyClass(Class<?> theClass) | 是 |
| Job | setMapOutputValueClass(Class<?> theClass) | 是 |
| Job | setMapperClass(Class<? extends Mapper> cls) | 是 |
| Job | setMapSpeculativeExecution(boolean speculativeExecution) | 空實現 |
| Job | setMaxMapAttempts(int n) | 空實現 |
| Job | setMaxReduceAttempts(int n) | 空實現 |
| Job | setNumReduceTasks(int tasks) | 是 |
| Job | setOutputFormatClass(Class<? extends OutputFormat> cls) | 否，拋異常 |
| Job | setOutputKeyClass(Class<?> theClass) | 是 |
| Job | setOutputValueClass(Class<?> theClass) | 是 |
| Job | setPartitionerClass(Class<? extends Partitioner> cls) | 是 |
| Job | setPriority(JobPriority priority) | 否，拋異常 |
| Job | setProfileEnabled(boolean newValue) | 空實現 |
| Job | setProfileParams(String value) | 空實現 |
| Job | setProfileTaskRange(boolean isMap, String newValue) | 空實現 |
| Job | setReducerClass(Class<? extends Reducer> cls) | 是 |
| Job | setReduceSpeculativeExecution(boolean speculativeExecution) | 空實現 |
| Job | setReservationId(ReservationId reservationId) | 否，拋異常 |
| Job | setSortComparatorClass(Class<? extends RawComparator> cls) | 否，拋異常 |
| Job | setSpeculativeExecution(boolean speculativeExecution) | 是 |
| Job | setTaskOutputFilter(Configuration conf, org.apache.hadoop.mapreduce.Job.TaskStatusFilter newValue) | 否，拋異常 |
| Job | setupProgress() | 否，拋異常 |
| Job | setUser(String user) | 空實現 |
| Job | setWorkingDirectory(Path dir) | 空實現 |
| Job | submit() | 是 |
| Job | toString() | 否，拋異常 |
| Job | waitForCompletion(boolean verbose) | 是 |
| Task Execution & Environment | mapreduce.map.java.opts | 空實現 |
| Task Execution & Environment | mapreduce.reduce.java.opts | 空實現 |
| Task Execution & Environment | mapreduce.map.memory.mb | 空實現 |
| Task Execution & Environment | mapreduce.reduce.memory.mb | 空實現 |
| Task Execution & Environment | mapreduce.task.io.sort.mb | 空實現 |
| Task Execution & Environment | mapreduce.map.sort.spill.percent | 空實現 |
| Task Execution & Environment | mapreduce.task.io.soft.factor | 空實現 |
| Task Execution & Environment | mapreduce.reduce.merge.inmem.thresholds | 空實現 |
| Task Execution & Environment | mapreduce.reduce.shuffle.merge.percent | 空實現 |
| Task Execution & Environment | mapreduce.reduce.shuffle.input.buffer.percent | 空實現 |
| Task Execution & Environment | mapreduce.reduce.input.buffer.percent | 空實現 |
| Task Execution & Environment | mapreduce.job.id | 空實現 |
| Task Execution & Environment | mapreduce.job.jar | 空實現 |
| Task Execution & Environment | mapreduce.job.local.dir | 空實現 |
| Task Execution & Environment | mapreduce.task.id | 空實現 |
| Task Execution & Environment | mapreduce.task.attempt.id | 空實現 |
| Task Execution & Environment | mapreduce.task.is.map | 空實現 |
| Task Execution & Environment | mapreduce.task.partition | 空實現 |
| Task Execution & Environment | mapreduce.map.input.file | 空實現 |
| Task Execution & Environment | mapreduce.map.input.start | 空實現 |
| Task Execution & Environment | mapreduce.map.input.length | 空實現 |
| Task Execution & Environment | mapreduce.task.output.dir | 空實現 |
| JobClient | cancelDelegationToken(Token |
否，拋異常 |
| JobClient | close() | 空實現 |
| JobClient | displayTasks(JobID jobId, String type, String state) | 否，拋異常 |
| JobClient | getAllJobs() | 否，拋異常 |
| JobClient | getCleanupTaskReports(JobID jobId) | 否，拋異常 |
| JobClient | getClusterStatus() | 否，拋異常 |
| JobClient | getClusterStatus(boolean detailed) | 否，拋異常 |
| JobClient | getDefaultMaps() | 否，拋異常 |
| JobClient | getDefaultReduces() | 否，拋異常 |
| JobClient | getDelegationToken(Text renewer) | 否，拋異常 |
| JobClient | getFs() | 否，拋異常 |
| JobClient | getJob(JobID jobid) | 否，拋異常 |
| JobClient | getJob(String jobid) | 否，拋異常 |
| JobClient | getJobsFromQueue(String queueName) | 否，拋異常 |
| JobClient | getMapTaskReports(JobID jobId) | 否，拋異常 |
| JobClient | getMapTaskReports(String jobId) | 否，拋異常 |
| JobClient | getQueueAclsForCurrentUser() | 否，拋異常 |
| JobClient | getQueueInfo(String queueName) | 否，拋異常 |
| JobClient | getQueues() | 否，拋異常 |
| JobClient | getReduceTaskReports(JobID jobId) | 否，拋異常 |
| JobClient | getReduceTaskReports(String jobId) | 否，拋異常 |
| JobClient | getSetupTaskReports(JobID jobId) | 否，拋異常 |
| JobClient | getStagingAreaDir() | 否，拋異常 |
| JobClient | getSystemDir() | 否，拋異常 |
| JobClient | getTaskOutputFilter() | 否，拋異常 |
| JobClient | getTaskOutputFilter(JobConf job) | 否，拋異常 |
| JobClient | init(JobConf conf) | 否，拋異常 |
| JobClient | isJobDirValid(Path jobDirPath, FileSystem fs) | 否，拋異常 |
| JobClient | jobsToComplete() | 否，拋異常 |
| JobClient | monitorAndPrintJob(JobConf conf, RunningJob job) | 否，拋異常 |
| JobClient | renewDelegationToken(Token |
否，拋異常 |
| JobClient | run(String[] argv) | 否，拋異常 |
| JobClient | runJob(JobConf job) | 是 |
| JobClient | setTaskOutputFilter(JobClient.TaskStatusFilter newValue) | 否，拋異常 |
| JobClient | setTaskOutputFilter(JobConf job, JobClient.TaskStatusFilter newValue) | 否，拋異常 |
| JobClient | submitJob(JobConf job) | 是 |
| JobClient | submitJob(String jobFile) | 否，拋異常 |
| JobConf | deleteLocalFiles() | 否，拋異常 |
| JobConf | deleteLocalFiles(String subdir) | 否，拋異常 |
| JobConf | normalizeMemoryConfigValue(long val) | 空實現 |
| JobConf | setCombinerClass(Class<? extends Reducer> theClass) | 是 |
| JobConf | setCompressMapOutput(boolean compress) | 空實現 |
| JobConf | setInputFormat(Class<? extends InputFormat> theClass) | 否，拋異常 |
| JobConf | setJar(String jar) | 否，拋異常 |
| JobConf | setJarByClass(Class cls) | 否，拋異常 |
| JobConf | setJobEndNotificationURI(String uri) | 否，拋異常 |
| JobConf | setJobName(String name) | 空實現 |
| JobConf | setJobPriority(JobPriority prio) | 否，拋異常 |
| JobConf | setKeepFailedTaskFiles(boolean keep) | 否，拋異常 |
| JobConf | setKeepTaskFilesPattern(String pattern) | 否，拋異常 |
| JobConf | setKeyFieldComparatorOptions(String keySpec) | 否，拋異常 |
| JobConf | setKeyFieldPartitionerOptions(String keySpec) | 否，拋異常 |
| JobConf | setMapDebugScript(String mDbgScript) | 空實現 |
| JobConf | setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass) | 空實現 |
| JobConf | setMapOutputKeyClass(Class<?> theClass) | 是 |
| JobConf | setMapOutputValueClass(Class<?> theClass) | 是 |
| JobConf | setMapperClass(Class<? extends Mapper> theClass) | 是 |
| JobConf | setMapRunnerClass(Class<? extends MapRunnable> theClass) | 否，拋異常 |
| JobConf | setMapSpeculativeExecution(boolean speculativeExecution) | 空實現 |
| JobConf | setMaxMapAttempts(int n) | 空實現 |
| JobConf | setMaxMapTaskFailuresPercent(int percent) | 空實現 |
| JobConf | setMaxPhysicalMemoryForTask(long mem) | 空實現 |
| JobConf | setMaxReduceAttempts(int n) | 空實現 |
| JobConf | setMaxReduceTaskFailuresPercent(int percent) | 空實現 |
| JobConf | setMaxTaskFailuresPerTracker(int noFailures) | 空實現 |
| JobConf | setMaxVirtualMemoryForTask(long vmem) | 空實現 |
| JobConf | setMemoryForMapTask(long mem) | 是 |
| JobConf | setMemoryForReduceTask(long mem) | 是 |
| JobConf | setNumMapTasks(int n) | 是 |
| JobConf | setNumReduceTasks(int n) | 是 |
| JobConf | setNumTasksToExecutePerJvm(int numTasks) | 空實現 |
| JobConf | setOutputCommitter(Class<? extends OutputCommitter> theClass) | 否，拋異常 |
| JobConf | setOutputFormat(Class<? extends OutputFormat> theClass) | 空實現 |
| JobConf | setOutputKeyClass(Class<?> theClass) | 是 |
| JobConf | setOutputKeyComparatorClass(Class<? extends RawComparator> theClass) | 否，拋異常 |
| JobConf | setOutputValueClass(Class<?> theClass) | 是 |
| JobConf | setOutputValueGroupingComparator(Class<? extends RawComparator> theClass) | 否，拋異常 |
| JobConf | setPartitionerClass(Class<? extends Partitioner> theClass) | 是 |
| JobConf | setProfileEnabled(boolean newValue) | 空實現 |
| JobConf | setProfileParams(String value) | 空實現 |
| JobConf | setProfileTaskRange(boolean isMap, String newValue) | 空實現 |
| JobConf | setQueueName(String queueName) | 否，拋異常 |
| JobConf | setReduceDebugScript(String rDbgScript) | 空實現 |
| JobConf | setReducerClass(Class<? extends Reducer> theClass) | 是 |
| JobConf | setReduceSpeculativeExecution(boolean speculativeExecution) | 空實現 |
| JobConf | setSessionId(String sessionId) | 空實現 |
| JobConf | setSpeculativeExecution(boolean speculativeExecution) | 否，拋異常 |
| JobConf | setUseNewMapper(boolean flag) | 是 |
| JobConf | setUseNewReducer(boolean flag) | 是 |
| JobConf | setUser(String user) | 空實現 |
| JobConf | setWorkingDirectory(Path dir) | 空實現 |
| FileInputFormat | 否，拋異常 | |
| TextInputFormat | 是 | |
| InputSplit | 否，拋異常 | |
| mapred.min.split.size. | 否，拋異常 | |
| FileSplit | 否，拋異常 | |
| map.input.file | 否，拋異常 | |
| RecordWriter | 否，拋異常 | |
| RecordReader | 否，拋異常 | |
| OutputFormat | 否，拋異常 | |
| OutputCommitter | abortJob(JobContext jobContext, int status) | 否，拋異常 |
| OutputCommitter | abortJob(JobContext context, JobStatus.State runState) | 否，拋異常 |
| OutputCommitter | abortTask(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | abortTask(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | cleanupJob(JobContext jobContext) | 否，拋異常 |
| OutputCommitter | cleanupJob(JobContext context) | 否，拋異常 |
| OutputCommitter | commitJob(JobContext jobContext) | 否，拋異常 |
| OutputCommitter | commitJob(JobContext context) | 否，拋異常 |
| OutputCommitter | commitTask(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | needsTaskCommit(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | needsTaskCommit(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | setupJob(JobContext jobContext) | 否，拋異常 |
| OutputCommitter | setupJob(JobContext jobContext) | 否，拋異常 |
| OutputCommitter | setupTask(TaskAttemptContext taskContext) | 否，拋異常 |
| OutputCommitter | setupTask(TaskAttemptContext taskContext) | 否，拋異常 |
| Counter | getDisplayName() | 是 |
| Counter | getName() | 是 |
| Counter | getValue() | 是 |
| Counter | increment(long incr) | 是 |
| Counter | setValue(long value) | 是 |
| Counter | setDisplayName(String displayName) | 是 |
| DistributedCache | CACHE_ARCHIVES | 否，拋異常 |
| DistributedCache | CACHE_ARCHIVES_SIZES | 否，拋異常 |
| DistributedCache | CACHE_ARCHIVES_TIMESTAMPS | 否，拋異常 |
| DistributedCache | CACHE_FILES | 否，拋異常 |
| DistributedCache | CACHE_FILES_SIZES | 否，拋異常 |
| DistributedCache | CACHE_FILES_TIMESTAMPS | 否，拋異常 |
| DistributedCache | CACHE_LOCALARCHIVES | 否，拋異常 |
| DistributedCache | CACHE_LOCALFILES | 否，拋異常 |
| DistributedCache | CACHE_SYMLINK | 否，拋異常 |
| DistributedCache | addArchiveToClassPath(Path archive, Configuration conf) | 否，拋異常 |
| DistributedCache | addArchiveToClassPath(Path archive, Configuration conf, FileSystem fs) | 否，拋異常 |
| DistributedCache | addCacheArchive(URI uri, Configuration conf) | 否，拋異常 |
| DistributedCache | addCacheFile(URI uri, Configuration conf) | 否，拋異常 |
| DistributedCache | addFileToClassPath(Path file, Configuration conf) | 否，拋異常 |
| DistributedCache | addFileToClassPath(Path file, Configuration conf, FileSystem fs) | 否，拋異常 |
| DistributedCache | addLocalArchives(Configuration conf, String str) | 否，拋異常 |
| DistributedCache | addLocalFiles(Configuration conf, String str) | 否，拋異常 |
| DistributedCache | checkURIs(URI[] uriFiles, URI[] uriArchives) | 否，拋異常 |
| DistributedCache | createAllSymlink(Configuration conf, File jobCacheDir, File workDir) | 否，拋異常 |
| DistributedCache | createSymlink(Configuration conf) | 否，拋異常 |
| DistributedCache | getArchiveClassPaths(Configuration conf) | 否，拋異常 |
| DistributedCache | getArchiveTimestamps(Configuration conf) | 否，拋異常 |
| DistributedCache | getCacheArchives(Configuration conf) | 否，拋異常 |
| DistributedCache | getCacheFiles(Configuration conf) | 否，拋異常 |
| DistributedCache | getFileClassPaths(Configuration conf) | 否，拋異常 |
| DistributedCache | getFileStatus(Configuration conf, URI cache) | 否，拋異常 |
| DistributedCache | getFileTimestamps(Configuration conf) | 否，拋異常 |
| DistributedCache | getLocalCacheArchives(Configuration conf) | 否，拋異常 |
| DistributedCache | getLocalCacheFiles(Configuration conf) | 否，拋異常 |
| DistributedCache | getSymlink(Configuration conf) | 否，拋異常 |
| DistributedCache | getTimestamp(Configuration conf, URI cache) | 否，拋異常 |
| DistributedCache | setArchiveTimestamps(Configuration conf, String timestamps) | 否，拋異常 |
| DistributedCache | setCacheArchives(URI[] archives, Configuration conf) | 否，拋異常 |
| DistributedCache | setCacheFiles(URI[] files, Configuration conf) | 否，拋異常 |
| DistributedCache | setFileTimestamps(Configuration conf, String timestamps) | 否，拋異常 |
| DistributedCache | setLocalArchives(Configuration conf, String str) | 否，拋異常 |
| DistributedCache | setLocalFiles(Configuration conf, String str) | 否，拋異常 |
| IsolationRunner | 否，拋異常 | |
| Profiling | 空實現 | |
| Debugging | 空實現 | |
| Data Compression | 是 | |
| Skipping Bad Records | 否，拋異常 | |
| Job Authorization | mapred.acls.enabled | 否，拋異常 |
| Job Authorization | mapreduce.job.acl-view-job | 否，拋異常 |
| Job Authorization | mapreduce.job.acl-modify-job | 否，拋異常 |
| Job Authorization | mapreduce.cluster.administrators | 否，拋異常 |
| Job Authorization | mapred.queue.queue-name.acl-administer-jobs | 否，拋異常 |
| MultipleInputs | 否，拋異常 | |
| Multi{anchor:_GoBack}pleOutputs | 是 | |
| org.apache.hadoop.mapreduce.lib.db | 否，拋異常 | |
| org.apache.hadoop.mapreduce.security | 否，拋異常 | |
| org.apache.hadoop.mapreduce.lib.jobcontrol | 否，拋異常 | |
| org.apache.hadoop.mapreduce.lib.chain | 否，拋異常 | |
| org.apache.hadoop.mapreduce.lib.db | 否，拋異常 |
最後更新：2016-10-18 11:23:16
上一篇： 原生SDK介紹__Java SDK介紹_MapReduce_大數據計算服務-阿裏雲
下一篇： 圖模型功能介紹__圖模型_大數據計算服務-阿裏雲
- 使用RAM實現KMS資源授權__API 參考_密鑰管理服務-阿裏雲
- MonitorItem__數據類型_API_API 網關-阿裏雲
- 類型2：大文件下載加速__用戶指南_CDN-阿裏雲
- JAVA版demo__設備基於CCP接入_設備端接入手冊_阿裏雲物聯網套件-阿裏雲
- AuthorizedApi__數據類型_API_API 網關-阿裏雲
- 重建集群實例__SDK接口說明_Python版SDK_批量計算-阿裏雲
- 機器翻譯服務協議__相關協議_平台介紹_數加平台介紹-阿裏雲
- 授權__使用手冊（調用API）_API 網關-阿裏雲
- 查詢申請批量生成設備狀態__接口列表_服務器端API_阿裏雲物聯網套件-阿裏雲
- 技術優勢對比__快照_產品簡介_雲服務器 ECS-阿裏雲
相關內容
- 常見錯誤說明__附錄_大數據計算服務-阿裏雲
- 發送短信接口__API使用手冊_短信服務-阿裏雲
- 接口文檔__Android_安全組件教程_移動安全-阿裏雲
- 運營商錯誤碼（聯通）__常見問題_短信服務-阿裏雲
- 設置短信模板__使用手冊_短信服務-阿裏雲
- OSS 權限問題及排查__常見錯誤及排除_最佳實踐_對象存儲 OSS-阿裏雲
- 消息通知__操作指南_批量計算-阿裏雲
- 設備端快速接入(MQTT)__快速開始_阿裏雲物聯網套件-阿裏雲
- 查詢API調用流量數據__API管理相關接口_API_API 網關-阿裏雲
- 使用STS訪問__JavaScript-SDK_SDK 參考_對象存儲 OSS-阿裏雲