Map Inference in the Face of Noise and Disparity代码重现遇到的问题（持续更新....)

旧城等待， 2023-07-18 02:37 94阅读 0赞

目录

    1. 论文链接
    1. 安装环境
    1. 遇到的问题和解决方法
    • 3.1 第一步运行kde.py
    • 3.2 第二步运行skeleton.py
      • 3.2.1 ImportError: No module named pyximport***
      • 3.2.2 Pychorm提示Unresolved reference 导入模块报错
      • 3.2.3 ImportError: Building module subiterations failed: [‘DistutilsPlatformError: Unable to find vcvarsall.bat\n’]（生成模块子迭代失败
      • 3.2.4 ImportError: Building module subiterations failed: [“CompileError: command ‘C:\\\\Users\\\\87792\\\\AppData\\\\Local\\\\Programs\\\\Common\\\\Microsoft\\\\Visual C++ for Python\\\\9.0\\\\VC\\\\Bin\\\\amd64\\\\cl.exe’ failed with exit status 2\n”]

1. 论文链接

Map Inference in the Face of Noise and Disparity
代码下载地址

2. 安装环境

python 2.7.15 win64位
Opencv 2.4.13 win64位 （安装过程可参考windows平台下python安装opencv，即实现import cv2功能）
pycharm 2019.3.3 win64位（来源微信公众号PyCharm2019【中文版】安装教程）

3. 遇到的问题和解决方法

3.1 第一步运行kde.py

  1. #coding:utf-8
  2. import cv2
  3. import cv2.cv as cv
  4. from math import atan2, sqrt, ceil, pi, fmod
  5. import sys, getopt, os
  6. from location import TripLoader
  7. from pylibs import spatialfunclib
  8. from itertools import tee, izip
  9. import sqlite3
  11. ##
  12. ## important parameters
  13. ##
  15. cell_size = 1 # meters
  16. gaussian_blur = 17
  17. trips_path = "trips/trips_1m/"
  19. def pairwise(iterable):
  20.     "s -> (s0,s1), (s1,s2), (s2, s3), ..."
  21.     a, b = tee(iterable)
  22.     next(b, None)
  23.     return izip(a, b)
  25. class KDE:
  26.     def __init__(self):
  27.         pass
  29.     def create_kde_with_trips(self, all_trips):
  31.         print "trips path: " + str(trips_path)
  32.         print "cell size: " + str(cell_size)
  33.         print "gaussian blur: " + str(gaussian_blur)
  35.         # flag to save images
  36.         save_images = True
  38.         sys.stdout.write("\nFinding bounding box... ")
  39.         sys.stdout.flush()
  41.         min_lat = all_trips[0].locations[0].latitude
  42.         max_lat = all_trips[0].locations[0].latitude
  43.         min_lon = all_trips[0].locations[0].longitude
  44.         max_lon = all_trips[0].locations[0].longitude
  46.         for trip in all_trips:
  47.             for location in trip.locations:
  48.                 if (location.latitude < min_lat):
  49.                     min_lat = location.latitude
  51.                 if (location.latitude > max_lat):
  52.                     max_lat = location.latitude
  54.                 if (location.longitude < min_lon):
  55.                     min_lon = location.longitude
  57.                 if (location.longitude > max_lon):
  58.                     max_lon = location.longitude
  60.         print "done."
  62.         # find bounding box for data
  63.         min_lat -= 0.003
  64.         max_lat += 0.003
  65.         min_lon -= 0.005
  66.         max_lon += 0.005
  68.         diff_lat = max_lat - min_lat
  69.         diff_lon = max_lon - min_lon
  71.         #print min_lat, min_lon, max_lat, max_lon
  73.         width = int(diff_lon * spatialfunclib.METERS_PER_DEGREE_LONGITUDE / cell_size)
  74.         height = int(diff_lat * spatialfunclib.METERS_PER_DEGREE_LATITUDE / cell_size)
  75.         yscale = height / diff_lat # pixels per lat
  76.         xscale = width / diff_lon # pixels per lon
  78.         # aggregate intensity map for all traces
  79.         themap = cv.CreateMat(height,width,cv.CV_16UC1)
  80.         cv.SetZero(themap)
  82.         ##
  83.         ## Build an aggregate intensity map from all the edges
  84.         ##
  86.         trip_counter = 1
  88.         for trip in all_trips:
  90.             if ((trip_counter % 10 == 0) or (trip_counter == len(all_trips))):
  91.                 sys.stdout.write("\rCreating histogram (trip " + str(trip_counter) + "/" + str(len(all_trips)) + ")... ")
  92.                 sys.stdout.flush()
  93.             trip_counter += 1
  95.             temp = cv.CreateMat(height,width,cv.CV_8UC1)
  96.             cv.SetZero(temp)
  97.             temp16 = cv.CreateMat(height,width,cv.CV_16UC1)
  98.             cv.SetZero(temp16)
  100.             for (orig,dest) in pairwise(trip.locations):
  101.                 oy = height - int(yscale * (orig.latitude - min_lat))
  102.                 ox = int(xscale * (orig.longitude - min_lon))
  103.                 dy = height - int(yscale * (dest.latitude - min_lat))
  104.                 dx = int(xscale * (dest.longitude - min_lon))
  105.                 cv.Line(temp, (ox, oy), (dx, dy), (32), 1, cv.CV_AA)
  107.             # accumulate trips into themap
  108.             cv.ConvertScale(temp,temp16,1,0)
  109.             cv.Add(themap,temp16,themap)
  111.         lines = cv.CreateMat(height,width,cv.CV_8U)
  112.         cv.SetZero(lines)
  114.         print "done."
  116.         trip_counter = 1
  118.         for trip in all_trips:
  120.             if ((trip_counter % 10 == 0) or (trip_counter == len(all_trips))):
  121.                 sys.stdout.write("\rCreating drawing (trip " + str(trip_counter) + "/" + str(len(all_trips)) + ")... ")
  122.                 sys.stdout.flush()
  123.             trip_counter += 1
  125.             for (orig, dest) in pairwise(trip.locations):
  126.                 oy = height - int(yscale * (orig.latitude - min_lat))
  127.                 ox = int(xscale * (orig.longitude - min_lon))
  128.                 dy = height - int(yscale * (dest.latitude - min_lat))
  129.                 dx = int(xscale * (dest.longitude - min_lon))
  130.                 cv.Line(lines, (ox, oy), (dx, dy), (255), 1, cv.CV_AA)
  132.         # save the lines
  133.         cv.SaveImage("raw_data.png", lines)
  135.         print "done."
  136.         #print "Intensity map acquired."
  137.         sys.stdout.write("Smoothing... ")
  138.         sys.stdout.flush()
  140.         # # create the mask and compute the contour
  141.         cv.Smooth(themap, themap, cv.CV_GAUSSIAN, gaussian_blur, gaussian_blur)
  142.         cv.SaveImage("kde.png", themap)
  144.         print "done."
  145.         print "\nKDE generation complete."
  147. if __name__ == '__main__':
  149.     opts,args = getopt.getopt(sys.argv[1:],"c:b:p:h")
  150.     for o,a in opts:
  151.         if o == "-c":
  152.             cell_size=int(a)
  153.         elif o == "-b":
  154.             gaussian_blur = int(a)    
  155.         elif o == "-p":
  156.             trips_path = str(a)
  157.         elif o == "-h":
  158.             print "Usage: kde.py [-c <cell_size>] [-b <gaussian_blur_size>] [-p <trips_path>] [-h]\n"
  159.             sys.exit()
  161.     k = KDE()
  162.     k.create_kde_with_trips(TripLoader.load_all_trips(trips_path))

报错如下：
no module named cv,查了好久才发现是因为自己的opencv版本不匹配，这段代码是用opencv2下写的，而我安装了opencv3所以一开始import cv 便开始报错，后来改成了 import cv2，在77行78行又报 no module named CreateMat 和 no module named SetZero ,后来安装了opencv2后此问题完美解决，opencv2下载链接和安装过程可参见（安装过程可参考windows平台下python安装opencv，即实现import cv2功能）。

3.2 第二步运行skeleton.py

  1. #coding:utf-8
  2. import pyximport; pyximport.install()
  3. import subiterations
  4. import numpy as np
  5. import scipy.ndimage as nd
  6. from scipy.ndimage import imread
  7. from scipy.misc import imsave, toimage
  8. from scipy.stats import threshold
  9. from itertools import izip
  10. from multiprocessing import Process, Manager, cpu_count
  11. from threading import Thread
  12. from scipy.ndimage.morphology import grey_closing
  13. import math
  15. skeleton_images_path = "skeleton_images/"
  17. class GrayscaleSkeleton:
  18.     def __init__(self):
  19.         pass
  21.     def skeletonize(self, image):
  22.         image = grey_closing(image, footprint=circle(8), mode='constant', cval=0.0)
  23.         image = add_zero_mat(image)
  24.         prev_binary_image = np.zeros_like(image)
  26.         image_bit_depth = (image.dtype.itemsize * 8) / 2
  27.         print "image_bit_depth: " + str(image_bit_depth)
  29.         #image_thresholds = range(2**image_bit_depth,-1,-16)
  30.         image_thresholds = [2**x for x in range(image_bit_depth, 3, -1)] + range(15, 0, -1)
  31.         print "image_thresholds: " + str(image_thresholds)
  33.         for curr_threshold in image_thresholds:
  34.             print "curr_threshold: " + str(curr_threshold)
  36.             curr_thresh_image = threshold(image, curr_threshold)
  38.             curr_binary_image = curr_thresh_image.astype(np.bool).astype(np.int)
  39.             imsave(skeleton_images_path + "binary_" + str(curr_threshold) + ".png", curr_binary_image)
  41.             curr_sum_image = (prev_binary_image + curr_binary_image)
  42.             curr_skeleton_image = self.thin_pixels(curr_sum_image)
  43.             imsave(skeleton_images_path + "skeleton_" + str(curr_threshold) + ".png", curr_skeleton_image)
  44.             print "curr_skeleton max: " + str(curr_skeleton_image.max())
  46.             prev_binary_image = curr_skeleton_image
  48.         return remove_zero_mat(prev_binary_image)
  50.     def thin_pixels(self, image):
  51.         pixel_removed = True
  53.         neighbors = nd.convolve((image>0).astype(np.int),[[1,1,1],[1,0,1],[1,1,1]],mode='constant',cval=0.0)
  54.         fg_pixels = np.where((image==1) & (neighbors >= 2) & (neighbors <= 6))
  55.     check_pixels = zip(fg_pixels[0], fg_pixels[1])
  57.         while len(check_pixels)>0:
  58.             print len(check_pixels)
  59.             (image, sub1_check_pixels) = self.parallel_sub(subiterations.first_subiteration, image, check_pixels) 
  60.             (image, sub2_check_pixels) = self.parallel_sub(subiterations.second_subiteration, image, list(set(check_pixels+sub1_check_pixels)))
  62.             check_pixels=list(set(sub1_check_pixels+sub2_check_pixels))
  64.     neighbors = nd.convolve(image>0,[[1,1,1],[1,0,1],[1,1,1]],mode='constant',cval=0.0)
  65.     fg_pixels = np.where(image==1)
  66.     check_pixels = zip(fg_pixels[0],fg_pixels[1])
  67.         (image, _) = self.parallel_sub(self.empty_pools, image, check_pixels)
  68.         return image
  70.     def parallel_sub(self, sub_function, image, fg_pixels):
  71.         manager = Manager()
  72.         queue = manager.Queue()
  73.         next_queue = manager.Queue()
  75.         num_procs = int(math.ceil(float(cpu_count()) * 0.75))
  76.         workload_size = int(math.ceil(float(len(fg_pixels)) / float(num_procs)))
  78.         process_list = []
  80.     if len(fg_pixels) == 0:
  81.             return (image, [])
  83.     (zero_pixels, next_pixels) = sub_function(image,fg_pixels)
  84.     for (x,y) in zero_pixels:
  85.             image[x][y]=0;
  87.         return (image, next_pixels)
  89.     def PRE_first_subiteration(self, curr_image, fg_pixels):
  90.         zero_pixels = { }
  91.     next_pixels = { }
  93.         for (i, j) in fg_pixels:
  94.             if curr_image[i][j] != 1: continue
  96.             p2 = curr_image[i - 1][j] 
  97.             p3 = curr_image[i - 1][j + 1] 
  98.             p4 = curr_image[i][j + 1] 
  99.             p5 = curr_image[i + 1][j + 1] 
  100.             p6 = curr_image[i + 1][j] 
  101.             p7 = curr_image[i + 1][j - 1] 
  102.             p8 = curr_image[i][j - 1]  
  103.             p9 = curr_image[i - 1][j - 1] 
  105.             if (2 <= (bool(p2) + bool(p3) + bool(p4) + bool(p5) + bool(p6) + bool(p7) + bool(p8) + bool(p9)) <= 6 and
  106.                 (p2 * p4 * p6 == 0) and 
  107.         (p4 * p6 * p8 == 0)):
  108.                 if ((not p2 and p3) + (not p3 and p4) + (not p4 and p5) + (not p5 and p6) + (not p6 and p7) + (not p7 and p8) + (not p8 and p9) + (not p9 and p2) == 1):      
  109.                     zero_pixels[(i,j)] = 0
  110.                     if p2 == 1:
  111.             next_pixels[(i-1,j)]=0
  112.                     if p3 == 1:
  113.             next_pixels[(i-1,j+1)]=0
  114.                     if p4 == 1:
  115.             next_pixels[(i,j+1)]=0
  116.                     if p5 == 1:
  117.             next_pixels[(i+1,j+1)]=0
  118.                     if p6 == 1:
  119.             next_pixels[(i+1,j)]=0
  120.                     if p7 == 1:
  121.             next_pixels[(i+1,j-1)]=0
  122.                     if p8 == 1:
  123.             next_pixels[(i,j-1)]=0
  124.                     if p9 == 1:
  125.             next_pixels[(i-1,j-1)]=0
  127.         return zero_pixels.keys(), next_pixels.keys()
  129.     def PRE_second_subiteration(self, curr_image, fg_pixels):
  130.         zero_pixels = { }
  131.     next_pixels = { }
  133.         for (i, j) in fg_pixels:
  134.             if curr_image[i][j] != 1: continue
  136.             p2 = curr_image[i - 1][j] 
  137.             p3 = curr_image[i - 1][j + 1] 
  138.             p4 = curr_image[i][j + 1] 
  139.             p5 = curr_image[i + 1][j + 1] 
  140.             p6 = curr_image[i + 1][j] 
  141.             p7 = curr_image[i + 1][j - 1] 
  142.             p8 = curr_image[i][j - 1]  
  143.             p9 = curr_image[i - 1][j - 1] 
  145.             if (2 <= (bool(p2) + bool(p3) + bool(p4) + bool(p5) + bool(p6) + bool(p7) + bool(p8) + bool(p9)) <= 6 and
  146.                 (p2 * p4 * p8 == 0) and 
  147.         (p2 * p6 * p8 == 0)):
  148.                 if ((not p2 and p3) + (not p3 and p4) + (not p4 and p5) + (not p5 and p6) + (not p6 and p7) + (not p7 and p8) + (not p8 and p9) + (not p9 and p2) == 1):      
  149.                     zero_pixels[(i,j)] = 0
  150.                     if p2 == 1:
  151.             next_pixels[(i-1,j)]=0
  152.                     if p3 == 1:
  153.             next_pixels[(i-1,j+1)]=0
  154.                     if p4 == 1:
  155.             next_pixels[(i,j+1)]=0
  156.                     if p5 == 1:
  157.             next_pixels[(i+1,j+1)]=0
  158.                     if p6 == 1:
  159.             next_pixels[(i+1,j)]=0
  160.                     if p7 == 1:
  161.             next_pixels[(i+1,j-1)]=0
  162.                     if p8 == 1:
  163.             next_pixels[(i,j-1)]=0
  164.                     if p9 == 1:
  165.             next_pixels[(i-1,j-1)]=0
  167.         return zero_pixels.keys(), next_pixels.keys()
  169.     def empty_pools(self, curr_image, fg_pixels):
  170.         zero_pixels = { }
  172.         for (i, j) in fg_pixels:
  173.             p2 = curr_image[i - 1][j]
  174.             p3 = curr_image[i - 1][j + 1]
  175.             p4 = curr_image[i][j + 1]
  176.             p5 = curr_image[i + 1][j + 1]
  177.             p6 = curr_image[i + 1][j]
  178.             p7 = curr_image[i + 1][j - 1]
  179.             p8 = curr_image[i][j - 1]
  180.             p9 = curr_image[i - 1][j - 1]
  182.             if (bool(p2) + bool(p3) + bool(p4) + bool(p5) + bool(p6) + bool(p7) + bool(p8) + bool(p9) > 6):
  183.                 zero_pixels[(i,j)] = 0
  185.         return zero_pixels,[]
  187. #
  188. # helper functions
  189. #
  190. def add_zero_mat(image):
  191.     num_rows, num_cols = image.shape
  193.     image = np.insert(image, num_rows, np.zeros(num_cols, dtype=np.int), 0)
  194.     image = np.insert(image, 0, np.zeros(num_cols, dtype=np.int), 0)
  196.     num_rows, num_cols = image.shape
  198.     image = np.insert(image, num_cols, np.zeros(num_rows, dtype=np.int), 1)
  199.     image = np.insert(image, 0, np.zeros(num_rows, dtype=np.int), 1)
  201.     return image
  203. def remove_zero_mat(image):
  204.     num_rows, num_cols = image.shape
  206.     image = np.delete(image, num_rows - 1, 0)
  207.     image = np.delete(image, 0, 0)
  208.     image = np.delete(image, num_cols - 1, 1)
  209.     image = np.delete(image, 0, 1)
  211.     return image
  213. def circle(radius):
  214.     x, y = np.mgrid[:(2 * radius) + 1, :(2 * radius) + 1]
  215.     circle = (x - radius) ** 2 + (y - radius) ** 2
  216.     return (circle <= (radius ** 2)).astype(np.int)
  218. import sys, time
  219. if __name__ == '__main__':
  220.     input_filename = str(sys.argv[1])
  221.     output_filename = str(sys.argv[2])
  223.     print "input filename: " + str(input_filename)
  224.     print "output filename: " + str(output_filename)
  226.     input_kde = imread(input_filename)
  228.     s = GrayscaleSkeleton()
  230.     start_time = time.time()
  231.     skeleton = s.skeletonize(input_kde)
  232.     print "total elapsed time: " + str(time.time() - start_time) + " seconds"
  234.     toimage(skeleton, cmin=0, cmax=255).save(output_filename)

3.2.1 ImportError: No module named pyximport***

解决方案：
保证安装了cython，可在https://www.lfd.uci.edu/~gohlke/pythonlibs/下载对应版本，然后通过pip安装，然后，在代码中import相应包之前，添加如下代码：

  1. import pyximport; pyximport.install()
  2. import subiterations

3.2.2 Pychorm提示Unresolved reference 导入模块报错

具体情况和解决办法可参考这篇文章，亲测有效https://www.cnblogs.com/NancyRM/p/8258372.html

3.2.3 ImportError: Building module subiterations failed: [‘DistutilsPlatformError: Unable to find vcvarsall.bat\n’]（生成模块子迭代失败

在这里插入图片描述（1）关于 ‘DistutilsPlatformError: Unable to find vcvarsall.bat\n’的解决可见
Unable to find vcvarsall.bat 里面整理的非常全面，找到python2.7的路径：D:\Python27\Lib\distutils

找到：msvc9compiler.py修改两个地方：具体的路径以自己安装路径为准
如下：

  1. def get_build_version():
  2.     """Return the version of MSVC that was used to build Python. For Python 2.3 and up, the version number is included in sys.version. For earlier versions, assume the compiler is MSVC 6. """
  3.     return 9.0
  4.     prefix = "MSC v."
  5.     i = sys.version.find(prefix)
  6.     if i == -1:
  7.         return 6
  8.     i = i + len(prefix)
  9.     s, rest = sys.version[i:].split(" ", 1)
  10.     majorVersion = int(s[:-2]) - 6
  11.     minorVersion = int(s[2:3]) / 10.0
  12.     # I don't think paths are affected by minor version in version 6
  13.     if majorVersion == 6:
  14.         minorVersion = 0
  15.     if majorVersion >= 6:
  16.         return majorVersion + minorVersion
  17.     # else we don't know what version of the compiler this is
  18.     return None
  20. def find_vcvarsall(version):
  21.     """Find the vcvarsall.bat file At first it tries to find the productdir of VS 2008 in the registry. If that fails it falls back to the VS90COMNTOOLS env var. """
  22.     return r'C:\Users\87792\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\vcvarsall.bat'
  23.     vsbase = VS_BASE % version
  24.     try:
  25.         productdir = Reg.get_value(r"%s\Setup\VC" % vsbase,
  26.                                    "productdir")
  27.     except KeyError:
  28.         productdir = None

3.2.4 ImportError: Building module subiterations failed: [“CompileError: command ‘C:\\Users\\87792\\AppData\\Local\\Programs\\Common\\Microsoft\\Visual C++ for Python\\9.0\\VC\\Bin\\amd64\\cl.exe’ failed with exit status 2\n”]

暂时还未找到解决办法

发表评论

表情：
评论列表 （有 0 条评论，94人围观）

还没有评论，来说两句吧...

相关阅读