jefferyjob/go-easy-utils

Quick toolbox for common data processing developed by Go language。Go语言开发的常用数据处理的快捷工具箱。

go-easy-utils

English | 简体中文

Introduction

This is a general data type processing tool class based on Go language, which helps developers process common data types and data operations in business code implementation. It allows you to focus on the implementation of your business code without processing the basic data type conversion and validation functions. The non-intrusive design of the tool library can make your business code easier to read and elegant.

Quick Start

Install

Use users with Go1.18 and above, it is recommended to install v2.x.x. Because v2.x.x app rewritten most functions of Go1.18

go get -u github.com/jefferyjob/go-easy-utils/v2

Users who use versions below Go1.18, please use v1.x version

Use Demo

package main

import (
	"fmt"
	"github.com/jefferyjob/go-easy-utils/v2/sliceUtil"
)

func main() {
	var slice = []string{"this", "is", "go", "easy", "utils"}
	chunkSlice := sliceUtil.ChunkSlice(slice, 2)
	fmt.Printf("%v", chunkSlice)
}

Function list

Package name	Function Outline	Document
anyUtil	Convert any type of data to the specified type	README
byteUtil	Conversion of byte array	README
cryptoUtil	Various encryption processing	README
emojiUtil	Decoding and encoding of emoji expression	README
floatUtil	Floating-point data processing	README
intUtil	Numerical data processing	README
jsonUtil	Json data conversion, support weak type conversion	README
mapUtil	Map type data processing	README
mathUtil	The Math function can handle values within the range of integers and floats.	README
randUtil	Random number generation, including: number, string, byte array	README
sliceUtil	Slice processing (grouping, summation, transformation, merging, etc.)	README
strUtil	String conversion processing	README
validUtil	Common data verification, such as: Chinese, English, name, ID number, phone number, email	README

Sponsorship and support

go-easy-utils Thank JetBrains for their support

go-easy-utils's Issues

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/8

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/7

Feature：jsonToStruct supports interface type assignment

At the beginning of the design, due to the strong typing properties of the language, it is not recommended to define data types vaguely. So the definition of interface{} and any type is not supported.

However, considering the affordability of some businesses, these two types need to be supported, so this requirement will support the definition of interface{} and any type.

func TestJsonToStructAny1(t *testing.T) {
	jsonData := `{
		"name": "make",
		"age": "10"
	}`
	type Target struct {
		Name interface{} `json:"name"`
		Age  uint        `json:"age"`
	}
	var target Target
	err := JsonToStruct(jsonData, &target)
	if err != nil {
		t.Errorf("err %s", err)
		return
	}
}

`Chunk(slice []interface{}, size int) [][]interface{}`换成any是否会更好?

func Chunk[T any](slice []T, size int) [][]T {
var chunks [][]T
for i := 0; i < len(slice); i += size {
end := i + size
if end > len(slice) {
end = len(slice)
}
chunks = append(chunks, slice[i:end])
}
return chunks
}

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/3

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/1

过多的使用反射

go-easy-utils/mathUtil/ceil.go

Line 9 in 0811e07

func Ceil[T float32 | float64](num T) int {

这种方法完全可以不使用反射，可以这样写func Ceil[T float32 | float64](num T) int {
if num == 0{return 0 }
return int(math.Ceil(float64(num)))
}

There is a bug in how jsonToStruct parses maps and slices.

There is a bug in how jsonToStruct parses maps and slices.

1. Does not support parsing map type
2. Parse the slice type, if the data type is inconsistent, panic error

type Target struct {
	Followed map[string]bool `json:"followed"`
	Fids     []string        `json:"fids"`
}

func TestJsonToStruct(t *testing.T) {
	data := `
	{
		"followed": {
			"43015653": true,
			"43015666": false
		},
		"fids": ["43015653",43015666]
	}
	`

	var event Target
	err := JsonToStruct(data, &event)
	fmt.Printf("%+v, err:%s \n", event, err)
}

The specific error description is as follows

panic: reflect.Set: value of type float64 is not assignable to type string [recovered]
	panic: reflect.Set: value of type float64 is not assignable to type string

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/2

应用go泛型

go.mod中go的版本是1.18，已经支持泛型，为何没有应用泛型，存在大量的重复代码和interface{}。

// MergeSlices 将多个slice合并成一个slice
func MergeSlices(slices ...[]interface{}) []interface{} {}

// MergeStrSlices 将多个slice合并成一个slice
func MergeStrSlices(slices ...[]string) []string {}

// MergeIntSlices 将多个slice合并成一个slice
func MergeIntSlices(slices ...[]int) []int {}

可以参考lancet

Fix code scanning alert - Incorrect conversion between integer types

Tracking issue for:

• https://github.com/jefferyjob/go-easy-utils/security/code-scanning/4

v2.0.0 当前开发中，将会支持 泛型 和 any

v1.0 为了快速适应本公司的业务，所以没有考虑any和泛型
v2.0 当前正在开发和自测中，将会在不久支持泛型和any，以兼容各个业务需求

有不少同学提出这个问题，这里统一回复一下，请大家期待后续版本的发布。

Can all errors be elevated to predefined types

go-easy-utils/jsonUtil/parse_map.go

Line 100 in 3c0b974

return fmt.Errorf("unsupported kind: %s", fieldVal.Kind())

I think errors like this can be improved to json_ to_ struct. go, it is convenient for developers to make incorrect type assertions