hrbrmstr/punycode

R code to work with punycode domains

punycode is an R package to work with punycode (RFC3492) domains and relies on the GNU IDN library for the hard parts.

Tested on Mac OS X & Ubuntu. It should work on Windows provided you install libidn. Anyone wanting to get this officially working on Windows gets accolades beyond imagining. You can install libidn on Ubuntu with sudo apt-get install libidn11-dev and on OS X with brew install libidn. yum install libidn seems to work on RedHat/CentOSish systems, too.

The following functions are implemented:

• puny_encode : Encode domains
• puny_deocde : Decode domains
• puny_tld_validate : Validate charset of domains (i.e. is allowed in TLD)
• is_idna : Test if a domain is IDNA encoded
• is_punycode : Test if a domain is Punycode encoded

Installation

devtools::install_github("hrbrmstr/punycode")

Usage

library(punycode)

# current verison
packageVersion("punycode")

## [1] '0.2.2'

ascii_doms <- c("xn------qpeiobbci9acacaca2c8a6ie7b9agmy.net",
"xn----0mcgcx6kho30j.com",
"xn----9hciecaaawbbp1b1cd.net",
"xn----9sbmbaig5bd2adgo.com",
"xn----ctbeewwhe7i.com",
"xn----ieuycya4cyb1b7jwa4fc8h4718bnq8c.com",
"xn----ny6a58fr8c8rtpsucir8k1bo62a.net",
"xn----peurf0asz4dzaln0qm161er8pd.biz",
"xn----twfb7ei8dwjzbf9dg.com",
"xn----ymcabp2br3mk93k.com")

intnl_doms <- c("ثبت-دومین.com",
"טיול-לפיליפינים.net",
"бизнес-тренер.com",
"новый-год.com",
"東京ライブ-バルーンスタンド.com",
"看護師高収入-求人.net",
"ユベラ-贅沢ポリフェノール.biz",
"เด็ก-ภูเก็ต.com",
"ایران-هاست.com")


for_valid <- c("gr€€n.no", "זגורי-אימפריה-לצפייה-ישירה.net", "ثبت-دومین.com",
"טיול-לפיליפינים.net", "xn------qpeiobbci9acacaca2c8a6ie7b9agmy.net", "xn----0mcgcx6kho30j.com",
"xn----9hciecaaawbbp1b1cd.net", "rudis.net")

puny_encode(ascii_doms)

##  [1] "זגורי-אימפריה-לצפייה-ישירה.net"  "ثبت-دومین.com"                   "טיול-לפיליפינים.net"            
##  [4] "бизнес-тренер.com"               "новый-год.com"                   "東京ライブ-バルーンスタンド.com"
##  [7] "看護師高収入-求人.net"           "ユベラ-贅沢ポリフェノール.biz"   "เด็ก-ภูเก็ต.com"                      
## [10] "ایران-هاست.com"

puny_decode(intnl_doms)

## [1] "xn----0mcgcx6kho30j.com"                   "xn----9hciecaaawbbp1b1cd.net"             
## [3] "xn----9sbmbaig5bd2adgo.com"                "xn----ctbeewwhe7i.com"                    
## [5] "xn----ieuycya4cyb1b7jwa4fc8h4718bnq8c.com" "xn----ny6a58fr8c8rtpsucir8k1bo62a.net"    
## [7] "xn----peurf0asz4dzaln0qm161er8pd.biz"      "xn----twfb7ei8dwjzbf9dg.com"              
## [9] "xn----ymcabp2br3mk93k.com"

puny_tld_check(for_valid)

## [1] FALSE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE  TRUE

is_punycode(c("gr€€n.no", "זגורי-אימפריה-לצפייה-ישירה.net", "ثبت-دومین.com",
"טיול-לפיליפינים.net", "xn------qpeiobbci9acacaca2c8a6ie7b9agmy.net", "xn----0mcgcx6kho30j.com",
"xn----9hciecaaawbbp1b1cd.net", "rudis.net"))

## [1] FALSE FALSE FALSE FALSE  TRUE  TRUE  TRUE FALSE

is_idna(c("gr€€n.no", "זגורי-אימפריה-לצפייה-ישירה.net", "ثبت-دومین.com",
"טיול-לפיליפינים.net", "xn------qpeiobbci9acacaca2c8a6ie7b9agmy.net", "xn----0mcgcx6kho30j.com",
"xn----9hciecaaawbbp1b1cd.net", "rudis.net"))

## [1]  TRUE  TRUE  TRUE  TRUE FALSE FALSE FALSE FALSE

Test Results

library(punycode)
library(testthat)

date()

## [1] "Sat Jul  4 21:01:35 2015"

test_dir("tests/")

## encoding : ..
## decoding : ..
## validation : .
## is : ..
## 
## You are a coding rockstar!

punycode's Issues

Preserve NAs on the puny_encode and puny_decode

The functions do not preserve NAs, instead replacing them with the string "NA"

Simple example:

> punycode::puny_decode(NA_character_)
[1] "NA"
> punycode::puny_encode(NA_character_)
[1] "NA"