替代shed_getaffinity,cpu_set_t等?

时间:2017-07-21 00:09:09

标签: c macos mpi affinity

所以当我遇到这种东西时,我就是一个菜鸟。

我正努力在macOS上编写一个气候模型,我已经把它归结为这里发生的事情:

#define _GNU_SOURCE

#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <unistd.h>
#include <sched.h>
#include <errno.h>
#include <sys/resource.h>
#include <sys/syscall.h>

static pid_t gettid(void)
{
  return syscall(__NR_gettid);
}

/*                                                                                                                                                                                                                                 
 * Returns this thread's CPU affinity, if bound to a single core,                                                                                                                                                                  
 * or else -1.           




*/
int get_cpu_affinity(void)
{
  cpu_set_t coremask;           /* core affinity mask */

  CPU_ZERO(&coremask);
  if (sched_getaffinity(gettid(),sizeof(cpu_set_t),&coremask) != 0) {
    fprintf(stderr,"Unable to get thread %d affinity. 

%s\n",gettid(),strerror(errno));
  }

  int cpu;
  int first_cpu = -1;   /* first CPU in range */
  int last_cpu = -1;    /* last CPU in range */
  for (cpu=0;cpu < CPU_SETSIZE;cpu++) {
    if (CPU_ISSET(cpu,&coremask)) {
      if (first_cpu == -1) {
         first_cpu = cpu;
      } else {
        last_cpu = cpu;
      }
    }
  }

  return (last_cpu == -1) ? first_cpu : -1;

}

int get_cpu_affinity_(void) { return get_cpu_affinity(); }      /* Fortran interface */


/*                                                                                                                                                                                                                                 
 * Set CPU affinity to one core.                                                                                                                                                                                                   
 */

void set_cpu_affinity( int cpu )
{
  cpu_set_t coremask;           /* core affinity mask */

  CPU_ZERO(&coremask);
  CPU_SET(cpu,&coremask);
  if (sched_setaffinity(gettid(),sizeof(cpu_set_t),&coremask) != 0) {
    fprintf(stderr,"Unable to set thread %d affinity. %s\n",gettid(),strerror(errno));

  }
}

void set_cpu_affinity_(int *cpu) { set_cpu_affinity(*cpu); }    /* Fortran interface */

编译时我遇到了一些错误:

首先 - 标识符&#34; cpu_set_t&#34;未定义,第二 - 标识符&#34; CPU_SETSIZE&#34;未定义

我已经完成了我的Google搜索,在我看来sched_getaffinitiy(),cpu_set_t以及其他一些东西在macOS中都不存在。

对于所有类型的C编程,我真的超出了我的深度。我想知道这里是否有人知道为macOS执行此操作的另一种方法以及我如何能够这样做。

我已附上以下完整的错误报告。

亲切的问候,

尼尔:)

完整的错误报告:

(python2) salvare:MASTERS Neil$ python run.py
Working directory for exp 'playground' already exists
RRTM compilation disabled.  Namelist set to gray radiation.
Writing path_names to '/Users/Neil/MASTERS/ISCA_TEMP/playground/path_names'
Running compiler
/Users/Neil/MASTERS/ISCA_TEMP/playground/compile.sh: line 21: module: command not found
loadmodules
/Users/Neil/MASTERS/Isca/src/extra/loadmodule: line 3: module: command not found
/Users/Neil/MASTERS/Isca/src/extra/loadmodule: line 4: module: command not found
/Users/Neil/MASTERS/Isca/src/extra/loadmodule: line 5: module: command not found
/Users/Neil/MASTERS/Isca/src/extra/loadmodule: line 6: module: command not found
/Users/Neil/MASTERS/ISCA_TEMP/playground/compile.sh: line 23: module: command not found
/Users/Neil/MASTERS/ISCA_TEMP/playground/compile.sh: line 24: ulimit: stack size: cannot modify limit: Operation not permitted
./compile_mppn.sh: line 13: module: command not found
./compile_mppn.sh: line 14: module: command not found
./compile_mppn.sh: line 15: module: command not found
 - mppnccombine.c:162:24: warning: format string is not a string literal (potentially insecure) [-Wformat-security]
sprintf(outfilename,argv[outputarg]); outlen=strlen(outfilename);
^~~~~~~~~~~~~~~
/usr/include/secure/_stdio.h:47:56: note: expanded from macro 'sprintf'
__builtin___sprintf_chk (str, 0, __darwin_obsz(str), __VA_ARGS__)
^~~~~~~~~~~
mppnccombine.c:162:24: note: treat the string as an argument to avoid this
sprintf(outfilename,argv[outputarg]); outlen=strlen(outfilename);
 ^
"%s",
/usr/include/secure/_stdio.h:47:56: note: expanded from macro 'sprintf'
__builtin___sprintf_chk (str, 0, __darwin_obsz(str), __VA_ARGS__)
^
1 warning generated.
ln: /Users/Neil/MASTERS/ISCA_TEMP/playground/exec/mppnccombine.x: File exists
 Makefile is ready.
mpicc -Duse_libMPI -Duse_netCDF -Duse_LARGEFILE -DINTERNAL_FILE_NML -DOVERLOAD_C8 -DRRTM_NO_COMPILE -I/usr/local/include -D__IFC  -c    /Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c
 ......................................................................................................................../Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(35): error: identifier "__NR_gettid" is undefined
eturn syscall(__NR_gettid);
 ^
/Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(44): error: identifier "cpu_set_t" is undefined
cpu_set_t coremask;     /* core affinity mask */
^
 /Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(47): error: identifier "cpu_set_t" is undefined
if (sched_getaffinity(gettid(),sizeof(cpu_set_t),&coremask) != 0) {
^
/Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(54): error: identifier "CPU_SETSIZE" is undefined
for (cpu=0;cpu < CPU_SETSIZE;cpu++) {
^
/Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(75): error: identifier "cpu_set_t" is undefined
cpu_set_t coremask;     /* core affinity mask */
^
/Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c(79): error: identifier "cpu_set_t" is undefined
if (sched_setaffinity(gettid(),sizeof(cpu_set_t),&coremask) != 0) {
 ^
compilation aborted for /Users/Neil/MASTERS/Isca/src/shared/mpp/affinity.c (code 2)
make: *** [affinity.o] Error 2
ERROR: mkmf failed for fms_moist
CRITICAL - Compilation failed.
Traceback (most recent call last):
  File "run.py", line 25, in <module>
    exp.compile()
  File "/Users/Neil/MASTERS/Isca/src/extra/python/gfdl/experiment.py", line 298, in compile
    raise e
sh.ErrorReturnCode_1: 

  RAN: /bin/bash /Users/Neil/MASTERS/ISCA_TEMP/playground/compile.sh

  STDOUT:


  STDERR:

1 个答案:

答案 0 :(得分:0)

您的Google搜索引导您走上正确的轨道 - sched_getaffinity()并且它使用的cpu_set_t结构是特定于Linux的,并非在所有平台上都可用。特别是Mac OSX似乎缺少它们。

然而,还有其他选择。我发现a blog post from someone porting code to OSX找到了使用sysctlbyname()的替代方案。该网站上的代码通过请求sched_getaffinity()在Mac OSX上重新实现machdep.cpu.core_count,并使用它来构建自己的cpu_set_t版本。