• 按键公众号 ：
按键精灵电脑版
立即下载

软件版本：2014.06
软件大小：22.9M
更新时间：2021-12-03

按键精灵安卓版
立即下载

软件版本：3.7.2
软件大小：46.2M
更新时间：2023-05-10

按键精灵iOS版
立即下载

软件版本：1.8.0
软件大小：29.2M
更新时间：2023-03-21

按键手机助手
立即下载

软件版本：3.8.0
软件大小：262M
更新时间：2023-05-30

快捷导航

请 登录 后使用快捷导航
没有帐号？ 注册

登录 注册
返回列表
发新话题 回复该主题
查看: 156|回复: 1

UMI识别文字方案的补全。得到文字坐标 [复制链接]

vencon
头像

  • 小学一年级
  • 9439662
  • 8
  • 0
  • 15 朵
  • 36 个
  • 21 个
  • 0
  • 2025-04-28
1#
t T
发表于 2025-05-11 14:21 | |只看楼主
本论坛的帖子 按键精灵调用Umi识别文字(本地无需做字库) _ 综合讨论 - 按键精灵论坛给出了本地建立服务器识别文字的方法。但我们要获取文字的同时还需要获取文字坐标，原帖子的方案就不行了。
原来想直接用按键精灵写个将图片在memory转码为base64的函数，但这个按键精灵的字节操作实在是乱，尝试了很久不行。后来用VB6直接做了个截屏转码的插件，解决了这个问题。
插件有2个函数
Plugin.SCTOBASE64.CaptureScreenRegionToBase64(x1, y1, x2, y2) 参数为目标区域相对屏幕的左上右下坐标，返回BASE64码
Plugin.SCTOBASE64.CaptureBackgroundWindowToBase64(hwd,x1, y1, x2, y2) 参数1为窗口句柄，记得是父窗口的句柄，这个在windows8以下不一定能返回正确图像，如果返回大量A，则找不到图像。

插件链接
通过网盘分享的文件：SCTOBASE64.zip
链接: https://pan.baidu.com/s/1CM7qL_On5LjbTe0EA40R6Q?pwd=qsqv 提取码: qsqv

以下的代码要下载论坛的免费神梦HTTP插件支持
  1. 返回文字
  2. Function 找字(x1, y1, x2, y2)
  3. Dim txt
  4. txt=""
  5. Dim URL,JsonData,json,username,password,base64
  6. URL = "http://127.0.0.1:1224/api/ocr"
  7. Base64 = Plugin.SCTOBASE64.CaptureScreenRegionToBase64(x1, y1, x2, y2)
  8. JsonData = SmHTTP.JsonData( _
  9. "base64",base64 , _
  10. "options", SmHTTP.JsonData( _
  11. "tbpu.parser","single_none",_
  12. "data.format","text"_
  13. ),_
  14. "Content-Type", "application/json" _
  15. )
  16. json = SmHTTP.HTTP_POST(URL, JsonData)
  17. If SmHTTP.GetStatus() = 200 Then
  18. If SmHTTP.GetJSON(json, "code") = 100 Then
  19. txt = SmHTTP.GetJSON(json, "data")
  20. If IsNull(txt) Then
  21. txt=""
  22. End If
  23. End If
  24. End If
  25. 找字=txt
  26. End Function

  28. Function 后台找字(hwd,x1, y1, x2, y2)
  29. Dim txt
  30. txt=""
  31. Dim URL,JsonData,json,username,password,base64
  32. URL = "http://127.0.0.1:1224/api/ocr"
  33. Base64 = Plugin.SCTOBASE64.CaptureBackgroundWindowToBase64(hwd,x1, y1, x2, y2)
  34. JsonData = SmHTTP.JsonData( _
  35. "base64",base64 , _
  36. "options", SmHTTP.JsonData( _
  37. "tbpu.parser","single_none",_
  38. "data.format","text"_
  39. ),_
  40. "Content-Type", "application/json" _
  41. )
  42. json = SmHTTP.HTTP_POST(URL, JsonData)
  43. If SmHTTP.GetStatus() = 200 Then
  44. If SmHTTP.GetJSON(json, "code") = 100 Then
  45. txt = SmHTTP.GetJSON(json, "data")
  46. If IsNull(txt) Then
  47. txt=""
  48. End If
  49. End If
  50. End If
  51. 后台找字=txt
  52. End Function

  54. //未找到 b(0,0)返回null，返回一个二维数组，第一维大小为5，b(0,0)文字内容,b(1,0)\b(2,0)\b(3,0)\b(4,0)文字相对的左上右下坐标。第二维为返回字符串数量
  55. Function 区域找字坐标(x1,y1,x2,y2)
  56. Redim findt(4, 0)
  57. findt(0, 0)=null
  58. Dim URL,JsonData,json,username,password,base64,counts
  59. URL = "http://127.0.0.1:1224/api/ocr"
  60. Base64 = Plugin.SCTOBASE64.CaptureScreenRegionToBase64(x1, y1, x2, y2)
  61. JsonData = SmHTTP.JsonData( _
  62. "base64",base64 , _
  63. "Content-Type", "application/json" _
  64. )
  65. json = SmHTTP.HTTP_POST(URL, JsonData)
  66. counts=字符串数量(json)
  67. TracePrint counts & json
  68. If SmHTTP.GetStatus() = 200 Then
  69. If SmHTTP.GetJSON(json, "code") = 100 Then
  70. Dim xx,i
  71. xx = null
  72. i=0
  73. xx =SmHTTP.GetJSON(json, "data[0]['text']")
  74. Do Until i>counts-1
  75. xx=null
  76. xx = SmHTTP.GetJSON(json, "data[" & i & "]['text']")
  77. If not IsNull(xx) and not IsEmpty(SmHTTP.GetJSON(json, "data["& i &"]['box'][0][0]")) and not IsNull(SmHTTP.GetJSON(json, "data["& i &"]['box'][0][0]")) Then
  78. If i > 0 Then
  79. Redim Preserve findt(4, i)
  80. End If
  81. findt(0,i) = SmHTTP.GetJSON(json, "data[" & i & "]['text']")
  82. findt(1,i)=SmHTTP.GetJSON(json, "data["& i &"]['box'][0][0]")
  83. findt(2,i)=SmHTTP.GetJSON(json, "data["& i &"]['box'][0][1]")
  84. findt(3,i)=SmHTTP.GetJSON(json, "data["& i &"]['box'][2][0]")
  85. findt(4, i) = SmHTTP.GetJSON(json, "data[" & i & "]['box'][2][1]")
  86. End If
  87. i=i+1
  88. loop
  89. Else
  90. findt(1, 0)=-1
  91. End If
  92. Else
  93. findt(1, 0)=-2
  94. End If
  95. 区域找字坐标=findt
  96. End Function
复制代码
插件的VB6代码
  1. '--------------------------------------------------------------------------
  2. ' 您可以在这里添加自己的插件函数，插件的制作和使用方法如下：
  3. ' 第一步：在下面添加插件函数，一个插件可以添加多个函数。
  4. ' 第二步：请修改下面的Get_Plugin_Description函数，加入插件和插件函数的说明信息，帮助信息会显示在按键精灵里方便使用
  5. ' 第三步：请修改Class Module（类模块）的名字，尽量用一些独特的名字避免和别人的插件名字冲突(默认是MyPluginName)
  6. ' 第四步：生成插件DLL！将DLL文件放到按键精灵的PLUGIN目录下，然后启动按键精灵测试您制作的插件功能是否正常
  7. ' 对插件有任何问题请发邮件给我们： [email]hi@vrbrothers.com[/email]
  8. '--------------------------------------------------------------------------

  10. Option Explicit

  12. ' API声明
  13. Private Declare Function GetDC Lib "user32" (ByVal hwnd As Long) As Long
  14. Private Declare Function CreateCompatibleDC Lib "gdi32" (ByVal hdc As Long) As Long
  15. Private Declare Function CreateCompatibleBitmap Lib "gdi32" (ByVal hdc As Long, ByVal nWidth As Long, ByVal nHeight As Long) As Long
  16. Private Declare Function SelectObject Lib "gdi32" (ByVal hdc As Long, ByVal hObject As Long) As Long
  17. Private Declare Function BitBlt Lib "gdi32" (ByVal hDestDC As Long, ByVal x As Long, ByVal y As Long, ByVal nWidth As Long, ByVal nHeight As Long, ByVal hSrcDC As Long, ByVal xSrc As Long, ByVal ySrc As Long, ByVal dwRop As Long) As Long
  18. Private Declare Function DeleteDC Lib "gdi32" (ByVal hdc As Long) As Long
  19. Private Declare Function DeleteObject Lib "gdi32" (ByVal hObject As Long) As Long
  20. Private Declare Function GetObject Lib "gdi32" Alias "GetObjectA" (ByVal hObject As Long, ByVal nCount As Long, lpObject As Any) As Long
  21. Private Declare Function GetDIBits Lib "gdi32" (ByVal aHDC As Long, ByVal hBitmap As Long, ByVal nStartScan As Long, ByVal nNumScans As Long, lpBits As Any, lpBI As Any, ByVal wUsage As Long) As Long
  22. Private Declare Sub CopyMemory Lib "kernel32" Alias "RtlMoveMemory" (Destination As Any, Source As Any, ByVal length As Long)
  23. Private Declare Function CryptBinaryToString Lib "crypt32.dll" Alias "CryptBinaryToStringA" (ByVal pbBinary As Long, ByVal cbBinary As Long, ByVal dwFlags As Long, ByVal pszString As String, ByRef pcchString As Long) As Long

  25. Private Declare Function SetForegroundWindow Lib "user32" (ByVal hwnd As Long) As Long


  28. ' API声明
  29. Private Declare Function FindWindow Lib "user32" Alias "FindWindowA" (ByVal lpClassName As String, ByVal lpWindowName As String) As Long
  30. Private Declare Function GetWindowRect Lib "user32" (ByVal hwnd As Long, lpRect As rect) As Long
  31. Private Declare Function GetClientRect Lib "user32" (ByVal hwnd As Long, lpRect As rect) As Long
  32. Private Declare Function ReleaseDC Lib "user32" (ByVal hwnd As Long, ByVal hdc As Long) As Long
  33. Private Declare Function PrintWindow Lib "user32.dll" (ByVal hwnd As Long, ByVal hdcBlt As Long, ByVal nFlags As Long) As Long

  35. '''''


  38. ' 结构体和常量
  39. Private Type rect
  40. Left As Long
  41. Top As Long
  42. Right As Long
  43. Bottom As Long
  44. End Type


  47. ' 常量定义
  48. Private Const CRYPT_STRING_BASE64 As Long = 1
  49. Private Const BI_RGB As Long = 0
  50. Private Const DIB_RGB_COLORS As Long = 0
  51. Private Const PW_RENDERFULLCONTENT As Long = 2 ' Windows 8+ 支持捕获完整内容


  54. ' 结构体定义
  55. Private Type BITMAP
  56. bmType As Long
  57. bmWidth As Long
  58. bmHeight As Long
  59. bmWidthBytes As Long
  60. bmPlanes As Integer
  61. bmBitsPixel As Integer
  62. bmBits As Long
  63. End Type

  65. Private Type BITMAPINFOHEADER
  66. biSize As Long
  67. biWidth As Long
  68. biHeight As Long
  69. biPlanes As Integer
  70. biBitCount As Integer
  71. biCompression As Long
  72. biSizeImage As Long
  73. biXPelsPerMeter As Long
  74. biYPelsPerMeter As Long
  75. biClrUsed As Long
  76. biClrImportant As Long
  77. End Type

  79. Private Type BITMAPFILEHEADER
  80. bfType As Integer
  81. bfSize As Long
  82. bfReserved1 As Integer
  83. bfReserved2 As Integer
  84. bfOffBits As Long
  85. End Type




  90. ' 截取后台窗口区域并转化为base64
  91. Public Function CaptureBackgroundWindowToBase64(hWndx As Long, ByVal x1 As Long, ByVal y1 As Long, ByVal x2 As Long, ByVal y2 As Long) As String
  92. Dim hwnd As Long, hdcWindow As Long, hdcMem As Long, hBitmap As Long, hOldBmp As Long
  93. Dim hdcMem2 As Long, hBitmap2 As Long, hOldBmp2 As Long
  94. Dim rect As rect, clientRect As rect, bmpInfo As BITMAPINFOHEADER, bmpFileHeader As BITMAPFILEHEADER
  95. Dim pixelBytes() As Byte, bytes() As Byte
  96. Dim bufferSize As Long, retVal As Long
  97. Dim tempStr As String

  99. Dim Width As Long: Width = x2 - x1 ' 截取宽度
  100. Dim Height As Long: Height = y2 - y1 ' 截取高度
  101. Dim srcX As Long: srcX = x1 ' 截取起始X坐标（相对窗口左上角）
  102. Dim srcY As Long: srcY = y1 ' 截取起始Y坐标（相对窗口左上角）
  103. ' 通过窗口标题获取句柄
  104. hwnd = hWndx
  105. If hwnd = 0 Then
  106. Exit Function
  107. End If

  109. ' 获取窗口位置（仅用于区域定位，实际截图用PrintWindow）
  110. GetWindowRect hwnd, rect
  111. GetClientRect hwnd, clientRect

  113. Debug.Print rect.Left & " " & rect.Top & " " & rect.Right&; " " & rect.Bottom
  114. Debug.Print clientRect.Left & " " & clientRect.Top & " " & clientRect.Right&; " " & clientRect.Bottom
  115. Dim winWidth As Long: winWidth = rect.Right - rect.Left
  116. Dim winHeight As Long: winHeight = rect.Bottom - rect.Top
  117. Dim offX As Long: offX = clientRect.Left - rect.Left '客户区相对于母窗口的偏移
  118. Dim offY As Long: offY = clientRect.Top - rect.Top
  119. ' 检查截取区域是否在窗口范围内
  120. If srcX + Width + offX > winWidth Or srcY + Height + offY > winHeight Then
  121. Exit Function
  122. End If

  124. ' 创建兼容DC和位图
  125. hdcWindow = GetDC(hwnd)
  126. hdcMem = CreateCompatibleDC(hdcWindow)
  127. hBitmap = CreateCompatibleBitmap(hdcWindow, winWidth, winHeight) ' 截取目标区域
  128. hOldBmp = SelectObject(hdcMem, hBitmap)
  129. Debug.Print hwnd
  130. ' 使用PrintWindow捕获后台窗口（PW_RENDERFULLCONTENT需Windows 8+）,win8以下这里设为0，但不一定能正常获取图像
  131. If PrintWindow(hwnd, hdcMem, PW_RENDERFULLCONTENT) = 0 Then
  132. GoTo Cleanup
  133. End If

  135. ' 创建第二个memoryDC和位图（用于截取目标区域）
  136. hdcMem2 = CreateCompatibleDC(hdcWindow)
  137. hBitmap2 = CreateCompatibleBitmap(hdcWindow, Width, Height)
  138. hOldBmp2 = SelectObject(hdcMem2, hBitmap2)

  140. ' 从原memoryDC的(srcX, srcY)位置复制目标区域到新位图
  141. If BitBlt(hdcMem2, 0, 0, Width, Height, hdcMem, srcX + offX, srcY + offY, vbSrcCopy) = 0 Then
  142. GoTo Cleanup
  143. End If


  146. ' 获取位图信息
  147. With bmpInfo
  148. .biSize = Len(bmpInfo)
  149. .biWidth = Width
  150. .biHeight = -Height ' 顶部到底部
  151. .biPlanes = 1
  152. .biBitCount = 24 ' 24位色
  153. .biCompression = BI_RGB
  154. .biSizeImage = ((Width * 3 + 3) \ 4) * 4 * Height ' 计算图像大小
  155. End With

  157. ' 获取像素数据
  158. ReDim pixelBytes(0 To bmpInfo.biSizeImage - 1)
  159. If GetDIBits(hdcMem2, hBitmap2, 0, Height, pixelBytes(0), bmpInfo, DIB_RGB_COLORS) = 0 Then
  160. ' MsgBox "获取像素数据失败！", vbExclamation
  161. GoTo Cleanup
  162. End If

  164. ' 构造BMP文件头
  165. With bmpFileHeader
  166. .bfType = &H4D42 ' "BM"
  167. .bfSize = Len(bmpFileHeader) + Len(bmpInfo) + bmpInfo.biSizeImage
  168. .bfOffBits = Len(bmpFileHeader) + Len(bmpInfo)
  169. End With

  171. ' 合并为完整BMP数据
  172. ReDim bytes(0 To bmpFileHeader.bfSize - 1)
  173. ' 1. bfType (2字节)
  174. bytes(0) = &H42 ' "B"
  175. bytes(1) = &H4D ' "M"
  176. ' 2. bfSize (4字节，小端序)
  177. CopyMemory bytes(2), bmpFileHeader.bfSize, 4
  178. ' 3. bfReserved1/2 (4字节)
  179. bytes(6) = 0: bytes(7) = 0: bytes(8) = 0: bytes(9) = 0
  180. ' 4. bfOffBits (4字节，小端序)
  181. CopyMemory bytes(10), bmpFileHeader.bfOffBits, 4

  183. CopyMemory bytes(Len(bmpFileHeader)), bmpInfo, Len(bmpInfo)
  184. CopyMemory bytes(Len(bmpFileHeader) + Len(bmpInfo)), pixelBytes(0), bmpInfo.biSizeImage

  186. ' 保存为BMP文件,此段注释掉，为检查代码能否正常运行设置

  188. 'Dim FileNum As Integer
  189. 'Dim FilePath As String
  190. ' FilePath = "d:\test2.bmp"
  191. ' FileNum = FreeFile()
  192. ' Open FilePath For Binary Access Write As #FileNum
  193. ' Put #FileNum, 1, bytes()
  194. ' Close #FileNum



  198. ' 转换为Base64
  199. bufferSize = 0
  200. CryptBinaryToString VarPtr(bytes(0)), UBound(bytes) + 1, CRYPT_STRING_BASE64, vbNullString, bufferSize
  201. tempStr = Space$(bufferSize)
  202. retVal = CryptBinaryToString(VarPtr(bytes(0)), UBound(bytes) + 1, CRYPT_STRING_BASE64, tempStr, bufferSize)
  203. If retVal Then
  204. tempStr = Left$(tempStr, bufferSize - 1)
  205. tempStr = Replace$(tempStr, vbCrLf, "") ' 先处理Windows换行符
  206. tempStr = Replace$(tempStr, vbCr, "") ' 再处理Mac旧换行符
  207. tempStr = Replace$(tempStr, vbLf, "") ' 最后处理Unix换行符
  208. CaptureBackgroundWindowToBase64 = Left$(tempStr, bufferSize - 1)
  209. End If


  212. Cleanup:
  213. ' 清理资源
  214. If hdcMem2 <> 0 Then
  215. SelectObject hdcMem2, hOldBmp2
  216. DeleteObject hBitmap2
  217. DeleteDC hdcMem2
  218. End If
  219. If hdcMem <> 0 Then
  220. SelectObject hdcMem, hOldBmp
  221. DeleteObject hBitmap
  222. DeleteDC hdcMem
  223. End If
  224. If hdcWindow <> 0 Then ReleaseDC hwnd, hdcWindow
  225. End Function

  227. ' 截取屏幕区域并返回Base64编码
  228. Public Function CaptureScreenRegionToBase64(ByVal x As Long, ByVal y As Long, ByVal x1 As Long, ByVal y1 As Long) As String
  229. Dim hScreenDC As Long, hMemDC As Long, hBitmap As Long, hOldBitmap As Long
  230. Dim bmp As BITMAP, bmpInfo As BITMAPINFOHEADER, bmpFileHeader As BITMAPFILEHEADER
  231. Dim pixelBytes() As Byte, bytes() As Byte
  232. Dim result As Long, bufferSize As Long, retVal As Long
  233. Dim tempStr As String
  234. Dim Width As Long, Height As Long
  235. Width = x1 - x
  236. Height = y1 - y
  237. ' 获取屏幕设备上下文
  238. hScreenDC = GetDC(0)
  239. If hScreenDC = 0 Then Exit Function

  241. ' 创建兼容DC和位图
  242. hMemDC = CreateCompatibleDC(hScreenDC)
  243. If hMemDC = 0 Then GoTo Cleanup
  244. hBitmap = CreateCompatibleBitmap(hScreenDC, Width, Height)
  245. If hBitmap = 0 Then GoTo Cleanup
  246. hOldBitmap = SelectObject(hMemDC, hBitmap)

  248. ' 复制屏幕区域
  249. result = BitBlt(hMemDC, 0, 0, Width, Height, hScreenDC, x, y, vbSrcCopy)
  250. If result = 0 Then GoTo Cleanup

  252. ' 获取位图信息
  253. GetObject hBitmap, Len(bmp), bmp


  256. ' 设置BITMAPINFOHEADER
  257. With bmpInfo
  258. .biSize = Len(bmpInfo)
  259. .biWidth = bmp.bmWidth
  260. .biHeight = -bmp.bmHeight ' 顶部到底部
  261. .biPlanes = 1
  262. .biBitCount = 24 ' 24位色
  263. .biCompression = BI_RGB
  264. .biSizeImage = ((bmp.bmWidth * 3 + 3) \ 4) * 4 * bmp.bmHeight ' 计算图像大小
  265. End With

  267. ' 获取像素数据
  268. ReDim pixelBytes(0 To bmpInfo.biSizeImage - 1)
  269. result = GetDIBits(hMemDC, hBitmap, 0, bmp.bmHeight, pixelBytes(0), bmpInfo, DIB_RGB_COLORS)
  270. If result = 0 Then GoTo Cleanup

  272. ' 构造BMP文件头
  273. With bmpFileHeader
  274. .bfType = &H4D42 ' "BM"
  275. .bfSize = Len(bmpFileHeader) + Len(bmpInfo) + bmpInfo.biSizeImage
  276. .bfOffBits = Len(bmpFileHeader) + Len(bmpInfo)
  277. End With

  279. ' 手动写入文件头（确保正确的字节顺序）
  280. ReDim bytes(0 To bmpFileHeader.bfSize - 1)
  281. ' 1. bfType (2字节)
  282. bytes(0) = &H42 ' "B"
  283. bytes(1) = &H4D ' "M"
  284. ' 2. bfSize (4字节，小端序)
  285. CopyMemory bytes(2), bmpFileHeader.bfSize, 4
  286. ' 3. bfReserved1/2 (4字节)
  287. bytes(6) = 0: bytes(7) = 0: bytes(8) = 0: bytes(9) = 0
  288. ' 4. bfOffBits (4字节，小端序)
  289. CopyMemory bytes(10), bmpFileHeader.bfOffBits, 4

  291. CopyMemory bytes(Len(bmpFileHeader)), bmpInfo, Len(bmpInfo)
  292. CopyMemory bytes(Len(bmpFileHeader) + Len(bmpInfo)), pixelBytes(0), bmpInfo.biSizeImage

  294. ' 保存为BMP文件,测试程序时使用，备注掉

  296. ' Dim FileNum As Integer
  297. ' Dim FilePath As String
  298. ' FilePath = "d:\test1.bmp"
  299. ' FileNum = FreeFile()
  300. ' Open FilePath For Binary Access Write As #FileNum
  301. ' Put #FileNum, 1, bytes()
  302. ' Close #FileNum



  306. ' 转换为Base64
  307. bufferSize = 0
  308. CryptBinaryToString VarPtr(bytes(0)), UBound(bytes) + 1, CRYPT_STRING_BASE64, vbNullString, bufferSize
  309. tempStr = Space$(bufferSize)
  310. retVal = CryptBinaryToString(VarPtr(bytes(0)), UBound(bytes) + 1, CRYPT_STRING_BASE64, tempStr, bufferSize)



  314. If retVal Then
  315. tempStr = Left$(tempStr, bufferSize - 1)
  316. tempStr = Replace$(tempStr, vbCrLf, "") ' 先处理Windows换行符
  317. tempStr = Replace$(tempStr, vbCr, "") ' 再处理Mac旧换行符
  318. tempStr = Replace$(tempStr, vbLf, "") ' 最后处理Unix换行符
  319. CaptureScreenRegionToBase64 = tempStr
  320. End If
  321. Cleanup:
  322. ' 清理资源
  323. If hMemDC <> 0 Then
  324. SelectObject hMemDC, hOldBitmap
  325. DeleteObject hBitmap
  326. DeleteDC hMemDC
  327. End If
  328. DeleteDC hScreenDC
  329. End Function

  331. '下面这个函数为您的插件提供帮助信息，请只修改和添加里面的描述信息，而不要修改函数本身
  332. Public Function Get_Plugin_Description(ItemName As String) As String
  333. Dim Description_Text As String
  334. Description_Text = ""
  335. Select Case ItemName
  336. Case ""
  337. Description_Text = "在这里写您的插件的说明信息"
  338. Case "CaptureBackgroundWindowToBase64"
  339. Description_Text = "CaptureBackgroundWindowToBase64,截取后台窗口区域图像并转为base64"
  340. Case "CaptureScreenRegionToBase64"
  341. Description_Text = "CaptureScreenRegionToBase64，截取屏幕区域图像并转为base64"

  343. '------------------------------------------------
  344. '为您的每个插件函数建立一个Case，就可以在按键精灵里显示插件的使用说明
  345. '------------------------------------------------
  346. End Select
  347. Get_Plugin_Description = Translate_Description(Description_Text)
  348. End Function

  350. '下面这个函数为您的插件提供显示模板信息，请只修改和添加里面的描述信息，而不要修改函数本身
  351. '描述信息中的$1 $2 ... 等内容再显示时将用第一个参数、第二个参数、... 代替
  352. Public Function Get_Plugin_Interpret_Template(ItemName As String) As String
  353. Dim Description_Text As String
  354. Description_Text = ""
  355. Select Case ItemName
  356. Case ""
  357. Description_Text = "在这里写您的插件的说明信息"
  358. Case "CaptureBackgroundWindowToBase64"
  359. Description_Text = "参数1为窗口句柄，参数2、3为截取图片左上角相对于后台窗口左上角的X/Y坐标，参数4、5为右下角坐标"
  360. Case "CaptureScreenRegionToBase64"
  361. Description_Text = "参数1、2为截取图片左上角的X/Y坐标，参数3、4为右下角坐标"

  363. '------------------------------------------------
  364. '为您的每个插件函数建立一个Case，就可以在按键精灵里显示插件的使用说明
  365. '------------------------------------------------
  366. End Select
  367. Get_Plugin_Interpret_Template = Translate_Description(Description_Text)
  368. End Function
复制代码
点赞
回顶部
bj917
头像

bj917

  • 初中一年级
  • 201390
  • 153
  • 0
  • 183 朵
  • 217 个
  • 182 个
  • 0
  • 2008-10-23
2#
t T
发表于 2025-05-19 14:24 | |只看该用户

umiocr返回的包含对应文字的坐标

假设umiocr返回的json为
{"data": [

{"box": [[1282, 1104], [1501, 1104], [1501, 1148], [1282, 1148]], "score": 0.9156272411346436, "text": "\u6276\u98ce\u53bf\u516c\u5b89\u5c40", "end": "\n"},

{"box": [[1282, 1185], [1563, 1185], [1563, 1222], [1282, 1222]],"score": 0.8834136128425598, "text": "20QP0531\u957f\u671f", "end": "\n"}

]
};

方括号里就是text对应的坐标
在浏览器里运行一下命令，就可以输出坐标（两个弹窗）
var json1={"data": [

{"box": [[1282, 1104], [1501, 1104], [1501, 1148], [1282, 1148]], "score": 0.9156272411346436, "text": "\u6276\u98ce\u53bf\u516c\u5b89\u5c40", "end": "\n"},

{"box": [[1282, 1185], [1563, 1185], [1563, 1222], [1282, 1222]],"score": 0.8834136128425598, "text": "20QP0531\u957f\u671f", "end": "\n"}

]
};
for(var i=0;i<json1.data.length;i++){alert(json1.data.box)}

此网页显示 1282.1104.1501.1104.1501.1148.1282.1148
此网页显示 1282,1185,1563,1185,1563,1222,1282,1222

回顶部
上一主题| 下一主题
返回列表
发新话题 回复该主题
高级编辑器高级编辑器